-- Logs begin at Thu 2022-10-13 12:30:34 UTC, end at Thu 2022-10-13 13:27:02 UTC. -- Oct 13 12:56:17.348758 dv-cinder-826607-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 12:56:17 2022] *** Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: nodename: dv-cinder-826607-8-smb Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: machine: x86_64 Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: clock source: unix Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: pcre jit disabled Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: detected number of CPU cores: 4 Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: current working directory: / Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: detected binary path: /usr/bin/uwsgi-core Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: your processes number limit is 47680 Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: your memory page size is 4096 bytes Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: detected max file descriptor number: 2048 Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: lock engine: pthread robust mutexes Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: thunder lock: enabled Oct 13 12:56:17.360497 dv-cinder-826607-8-smb devstack@keystone.service[81569]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 13 12:56:17.362960 dv-cinder-826607-8-smb devstack@keystone.service[81569]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 12:56:17.399382 dv-cinder-826607-8-smb devstack@keystone.service[81569]: Python main interpreter initialized at 0x5633d70ee9c0 Oct 13 12:56:17.399382 dv-cinder-826607-8-smb devstack@keystone.service[81569]: python threads support enabled Oct 13 12:56:17.399382 dv-cinder-826607-8-smb devstack@keystone.service[81569]: your server socket listen backlog is limited to 100 connections Oct 13 12:56:17.399382 dv-cinder-826607-8-smb devstack@keystone.service[81569]: your mercy for graceful operations on workers is 90 seconds Oct 13 12:56:17.399769 dv-cinder-826607-8-smb devstack@keystone.service[81569]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 12:56:17.399857 dv-cinder-826607-8-smb devstack@keystone.service[81569]: *** Operational MODE: preforking *** Oct 13 12:56:17.400097 dv-cinder-826607-8-smb devstack@keystone.service[81569]: *** uWSGI is running in multiple interpreter mode *** Oct 13 12:56:17.400097 dv-cinder-826607-8-smb devstack@keystone.service[81569]: spawned uWSGI master process (pid: 81569) Oct 13 12:56:17.400286 dv-cinder-826607-8-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 13 12:56:17.401383 dv-cinder-826607-8-smb devstack@keystone.service[81569]: spawned uWSGI worker 1 (pid: 81579, cores: 1) Oct 13 12:56:17.401383 dv-cinder-826607-8-smb devstack@keystone.service[81569]: spawned uWSGI worker 2 (pid: 81580, cores: 1) Oct 13 12:56:17.401383 dv-cinder-826607-8-smb devstack@keystone.service[81569]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 12:56:21.668087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 12:56:21.668087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: from cryptography.utils import int_from_bytes Oct 13 12:56:21.668866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 12:56:21.668866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: from cryptography.utils import int_from_bytes Oct 13 12:56:21.669309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 12:56:21.669309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: from cryptography.utils import int_from_bytes Oct 13 12:56:21.669424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 12:56:21.669424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: from cryptography.utils import int_from_bytes Oct 13 12:56:21.718853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 12:56:21.719033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 12:56:21.719169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 12:56:21.719263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] command line args: [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 12:56:21.719370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 12:56:21.719523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 12:56:21.719607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] command line args: [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 12:56:21.719688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ================================================================================ {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 12:56:21.719853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 12:56:21.719930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] admin_token = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ================================================================================ {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 12:56:21.720161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] config_dir = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] admin_token = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] config_source = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] config_dir = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] debug = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] config_source = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.720968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] debug = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.721833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.722176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.722396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.722604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.722803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.722975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_config_append = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.723166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.723358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.723567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_config_append = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.723801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_dir = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.723990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.724182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_file = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.724371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_dir = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.724561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.724755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_file = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.724996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.725164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.725361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.725562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.725752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.725980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.726144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.726334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.726527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.726725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.726927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.727163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.728463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.728601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.728728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.728862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.729912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] publish_errors = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.730896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] publish_errors = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.731928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] standard_threads = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] standard_threads = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.732974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] use_journal = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] use_json = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] use_stderr = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.733906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] use_journal = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] use_syslog = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] use_json = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] use_stderr = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] use_syslog = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.734775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 12:56:21.734854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.734929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735152 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.735953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.736986 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.737970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738261 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.738975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.739959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.740941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.741997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.742889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.743938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.744998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.745949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.746962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.747821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.748916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.749939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.750952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.751968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.752909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753705 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.753930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.754965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.external = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.755990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.external = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.password = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] auth.token = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.756905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.password = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] auth.token = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.757958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758412 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.758993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759829 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.759943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.760982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.761913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.762951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.763949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.764969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.765974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.766914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.767990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.768918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769261 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.769939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.770964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.771907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.772940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773408 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.773982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.774095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.774207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.774802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.774928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.775897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.776931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.777945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.778928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.779956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.780970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.781897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.782929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.783913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.784983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.785900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.786936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.787984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] role.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] role.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.788978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] role.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] role.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.789889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.790035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.790656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.790780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.790894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.791962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.792997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.793910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.794930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.795977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.796896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.797928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.798960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.799946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.connection = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.800889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.801944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.connection = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802412 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.802989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803457 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.803927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.804992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.805105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.805227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.805227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 12:56:21.805441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.805441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.805695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.805808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.806033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.806273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 12:56:21.806447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 12:56:21.834658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.834997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.835229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.841443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.841682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.841910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.845132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.851169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.873088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.873325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.877127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.877368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.927143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.927677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.979505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.979741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.982250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:21.982493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.138903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.139332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.139730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.139959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.140182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.140400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.141660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.141899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.142129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.142353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.142577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.142797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.164182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.164416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.164647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.164872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.165620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.165836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.165915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.166050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.166130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.166305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.166533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.166756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.166981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.167197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.177469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.177682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.191543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.191778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.192009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.192239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.192554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.192775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.192992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81579) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.193184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.193424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.193652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.193879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.194190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.194412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.194632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 12:56:22.209661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.209873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 12:56:22.210220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.210425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 12:56:22.210703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.210968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.211230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.211308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.211517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.211598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 12:56:22.212648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.213016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 12:56:22.213465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.213744 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.214016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.214285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.222146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.222433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.222708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.222993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.224147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.224440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.224722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.225016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.230550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.232655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.233471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.233762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.234055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.234346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.234638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.234907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.235184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.235486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.235767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.235950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.236049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.236321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.236453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.236950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.237439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.237959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.238335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.238628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.238925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.239451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.239983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.240405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.259428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.260901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.261191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.265440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.266056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.266546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.266840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.267019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.267309 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.272133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.272427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.272719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.273217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.273508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.279641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.279736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.279937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.280037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.280304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.280595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.280879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.281162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.281440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.281716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.286944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.287501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.287977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.288283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.288576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.288866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.289234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.289520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.298316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.298606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.302484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.306013 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.306102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.306301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.306394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.310575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.311693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.313732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.315676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.315986 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.317442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.317750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.318042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.318334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.318639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.318931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.320365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.323668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.326906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.327216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.327537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.327830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.328128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.328422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.334797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.335093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.335365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.335657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.343470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.345029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.346556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.346838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.347065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.347369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.347671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.347945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.349798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.350088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.350374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.350664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.351071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.355568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.358344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.360530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.360819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.363212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.363537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.363754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.363833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.364052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.364132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.364345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.364461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.364638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.364755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.365043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.365123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.377278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.377726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.378026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.378327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.378974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.379487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.379890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.380484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.383388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.386641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.388160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.389864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.390348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.390769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.396900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.397183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.398643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.400649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.404921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.405330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.405625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.405772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.405913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.407826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.409330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.409621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.410026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.415555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.415864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.416154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.419335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.421098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.423046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81579) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.423338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.423649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.423933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.424073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.424212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.424488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.424567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.424774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.424860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.425062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.425140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.425339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.425630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.425916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.426183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.426453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.426746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81579) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.433255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.433507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.433798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.442912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 12:56:22.443446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.443885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.444173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.444456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.444738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.445023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.445322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.445602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.445888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.446209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.446483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.446756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.447053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 12:56:22.461003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633d70ee9c0 pid: 81579 (default app) Oct 13 12:56:22.464948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9199-ec7a-42d5-b0c0-18ae67fb67e9 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:22.465236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9199-ec7a-42d5-b0c0-18ae67fb67e9 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:22.465510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9199-ec7a-42d5-b0c0-18ae67fb67e9 None None] PATH_INFO: `/v3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:22.470164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu Oct 13 12:56:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:22.485534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633d70ee9c0 pid: 81580 (default app) Oct 13 12:56:29.168480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:29.168984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:29.169085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:29.170356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:56:29.177758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:29.178287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:29.178287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:29.248211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: INFO dbcounter [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] Registered counter for database keystone Oct 13 12:56:29.266687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG oslo_db.sqlalchemy.engines [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 12:56:29.272852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writer thread running {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 12:56:29.454251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG passlib.handlers.bcrypt [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81580) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 12:56:29.454567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG passlib.handlers.bcrypt [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81580) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 12:56:29.512532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:29.514129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:29.640245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 12:56:30.123281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:30.192458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: INFO dbcounter [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] Registered counter for database keystone Oct 13 12:56:30.213288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG oslo_db.sqlalchemy.engines [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 12:56:30.219518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writer thread running {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 12:56:30.337432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c40fd-e804-4de3-ade7-23edde0c4183 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:30.341666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:30.342299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:30.342580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:30.342852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:30.350910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:30.402391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING keystone.common.rbac_enforcer.enforcer [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 12:56:30.402689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f37af4-82c5-4319-b97a-4c99c78fbff6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:30.411917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Oct 13 12:56:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 12:56:30.418433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:30.433943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5938267-d714-40f9-9c57-d6f4844d78ad None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:30.439308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:30.440436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:30.440719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:30.440992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] PATH_INFO: `/v3/projects/da5ea501d94c4d04b906442faafb4921` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:30.442422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] RBAC: Authorizing `identity:get_project(project_id=da5ea501d94c4d04b906442faafb4921)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:30.495440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING keystone.common.rbac_enforcer.enforcer [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 12:56:30.495790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb52de-034c-4c86-8b84-13376d2a520a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:30.500376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 12:56:30 2022] GET /identity/v3/projects/da5ea501d94c4d04b906442faafb4921 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:32.578796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d216-bebd-47c3-a23d-72c5280628e1 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:32.579314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d216-bebd-47c3-a23d-72c5280628e1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:32.579418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d216-bebd-47c3-a23d-72c5280628e1 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:32.583777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:56:32.589717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:32.590122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:32.590267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:32.609668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:32.611179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:32.618993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 12:56:32.894282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d216-bebd-47c3-a23d-72c5280628e1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:32.908390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d216-bebd-47c3-a23d-72c5280628e1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:32.913923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914b0c5-e382-4e22-a416-c8a996921c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:32.914539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914b0c5-e382-4e22-a416-c8a996921c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:32.914815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914b0c5-e382-4e22-a416-c8a996921c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:32.915082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914b0c5-e382-4e22-a416-c8a996921c4b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:32.922599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914b0c5-e382-4e22-a416-c8a996921c4b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:32.924446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914b0c5-e382-4e22-a416-c8a996921c4b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:32.933753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Oct 13 12:56:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 12:56:32.939042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:32.948644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c112d4-3740-4ea6-ad17-1d89f055457b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:32.952934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d704-c3fd-4eab-aa14-2cc4852ef8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:32.953554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d704-c3fd-4eab-aa14-2cc4852ef8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:32.953832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d704-c3fd-4eab-aa14-2cc4852ef8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:32.954103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d704-c3fd-4eab-aa14-2cc4852ef8c3 admin admin] PATH_INFO: `/v3/users/7689dbdad16d4fd1b82041f0857674c0` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:32.955448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d704-c3fd-4eab-aa14-2cc4852ef8c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7689dbdad16d4fd1b82041f0857674c0)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:32.957266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d704-c3fd-4eab-aa14-2cc4852ef8c3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:32.958760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu Oct 13 12:56:32 2022] GET /identity/v3/users/7689dbdad16d4fd1b82041f0857674c0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:35.136322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481568-23cf-44c7-9267-5e9cd6d73f42 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.136884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481568-23cf-44c7-9267-5e9cd6d73f42 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.136884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481568-23cf-44c7-9267-5e9cd6d73f42 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.138189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:35.143270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.143684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.143992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.161820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:35.163014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:35.181456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5b841-6f4f-4b66-a59c-da8a6fe8bc6b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.181741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5b841-6f4f-4b66-a59c-da8a6fe8bc6b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.182015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5b841-6f4f-4b66-a59c-da8a6fe8bc6b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.183339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 7/11] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:56:35.188346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.188629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.188898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.230431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG passlib.handlers.bcrypt [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81579) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 12:56:35.230816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG passlib.handlers.bcrypt [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81579) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 12:56:35.242481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:35.280212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:35.281852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:35.379331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:56:35.512522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:35.537645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:35.615010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cea72-5f44-4bd4-855a-58dcde233c3d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:35.645203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:35.647944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:35.648593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.648879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.649154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.660299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:35.669800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:35.670896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:35.671801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 6/14] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:56:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:35.676655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:35.752725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280b07-678c-42c7-883d-3ec8558f91bb None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:35.755015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:35.759361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:35.779441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea709-b15f-47fa-b49d-e037075c45f8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:35.791032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:35.791918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.792201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.792471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.793446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:35.794890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:35.805789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.sql.core [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 12:56:35.805789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 12:56:35.805789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [parameters: {'id': '08378c486ee644fdbb2d7a058057bc68', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 12:56:35.805789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 12:56:35.814362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:35.814975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.815258 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.815565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.816245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:35.816553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:35.817942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:56:35.824236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result.read() Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 12:56:35.825061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application yield resource Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise self.value Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application session.commit() Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 12:56:35.825975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.session.flush() Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application compat.raise_( Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 12:56:35.826896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 12:56:35.828017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result.read() Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:56:35.828899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [parameters: {'id': '08378c486ee644fdbb2d7a058057bc68', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 12:56:35.834409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:35.835468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:35.837204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 9/15] 10.222.0.25 () {60 vars in 1137 bytes} [Thu Oct 13 12:56:35 2022] POST /identity/v3/domains => generated 190 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:56:35.838071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 7/16] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:35.838149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:35.838232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:35.930793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb89c-eace-46bc-9639-d461167c30cd None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:35.934471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e850ec-a854-46b7-8ad0-9f49789fc20f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:35.963836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:35.964684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.964959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.965230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.967738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:35.968363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:35.968645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:35.968920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] PATH_INFO: `/v3/users/7689dbdad16d4fd1b82041f0857674c0` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:35.970049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] RBAC: Authorizing `identity:get_user(user_id=7689dbdad16d4fd1b82041f0857674c0)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:35.971537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:35.973104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 8/17] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:35 2022] GET /identity/v3/users/7689dbdad16d4fd1b82041f0857674c0 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:35.979177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:35.983647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:35.985139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:35.994510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:56:36.001290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:36.002141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:56:36.002923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:56:36.002923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:56:36.002923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:36.002923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:36.008187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:36.030383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:36.079735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6330fb0-6127-4f81-9ebb-66b0f541ca68 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:36.110494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e1e9-a7bf-490e-8645-a58b57934b44 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:36.112256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:36.112894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:36.113183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:36.113456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:36.114568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:36.116066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:36.118437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:36.123790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:36.143661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:36.144267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:36.144548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:36.144817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:36.145451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:36.145751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:36.147118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad034b18-1b37-4a98-a3c4-ca5b8984226b None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:36.164341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:36.204630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:36.225057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65c8d-42ae-4e88-bf93-f6a71c36f8be None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:36.260313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b447c-9025-43dc-8fd5-d07418e44b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:36.260989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b447c-9025-43dc-8fd5-d07418e44b66 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:36.261272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b447c-9025-43dc-8fd5-d07418e44b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:36.261548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b447c-9025-43dc-8fd5-d07418e44b66 None admin] PATH_INFO: `/v3/domains/default/users/7689dbdad16d4fd1b82041f0857674c0/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:36.263554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b447c-9025-43dc-8fd5-d07418e44b66 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7689dbdad16d4fd1b82041f0857674c0, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:36.265039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b447c-9025-43dc-8fd5-d07418e44b66 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:36.380395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1361 bytes} [Thu Oct 13 12:56:36 2022] PUT /identity/v3/domains/default/users/7689dbdad16d4fd1b82041f0857674c0/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 12:56:38.915074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e940-80b2-4e47-acfb-5aaf67805fee None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:38.915630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e940-80b2-4e47-acfb-5aaf67805fee None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:38.915630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e940-80b2-4e47-acfb-5aaf67805fee None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:38.917245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:38.929690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f6ce-9e59-4a1d-9e2c-dedc94d91367 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:38.930555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f6ce-9e59-4a1d-9e2c-dedc94d91367 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:38.931041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f6ce-9e59-4a1d-9e2c-dedc94d91367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:38.956590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5767f6ce-9e59-4a1d-9e2c-dedc94d91367 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:38.958445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5767f6ce-9e59-4a1d-9e2c-dedc94d91367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:39.049904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:39.078257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65e34-b0ad-4436-801c-905b112e3361 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.078587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65e34-b0ad-4436-801c-905b112e3361 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.078819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65e34-b0ad-4436-801c-905b112e3361 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.080238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:39.086593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb39c-50bf-4bbe-8794-7b59229eccfc None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.086879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb39c-50bf-4bbe-8794-7b59229eccfc None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.087156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb39c-50bf-4bbe-8794-7b59229eccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.112633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a2adb39c-50bf-4bbe-8794-7b59229eccfc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:39.113851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a2adb39c-50bf-4bbe-8794-7b59229eccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:39.205393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:39.206684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:39.282095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7c4d-08e0-4725-9259-a62e18c9dc03 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.282457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7c4d-08e0-4725-9259-a62e18c9dc03 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.282658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7c4d-08e0-4725-9259-a62e18c9dc03 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.284315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:39.289941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.290232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.290510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.320530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:39.321658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:39.360447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a34c3-0622-4fcc-b4f8-3bd60bb24dc5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.360736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a34c3-0622-4fcc-b4f8-3bd60bb24dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.361002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a34c3-0622-4fcc-b4f8-3bd60bb24dc5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.362337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 15/27] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:39.369380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.369659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.369929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.408435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:39.409641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:39.444714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 13/28] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:39.445613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:39.568093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:56:39.584485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380c59-b764-4459-be6a-aea01839d516 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:39.619773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:39.628170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:39.628819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.629105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.629385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.640898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:39.644535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:39.645966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:39.646771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:39.647536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 14/30] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:39.655317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:39.668015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:39.824576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623243a2-6f8a-407a-bd5e-087ffbf2d938 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:39.887706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02fe94-743c-4aca-9eca-eb2fbfd807c3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:39.895521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:39.896140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.901244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.901533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.902224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:39.902536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:39.904177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:39.922647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 15/31] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:39.928111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:39.946536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:39.947732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:39.948017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:39.948299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:39.959951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:39.962012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:56:39.979099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:39.980021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:56:39.980808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:56:39.980808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:56:39.980808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:39.980808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 17/32] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:39.981445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:40.035588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:40.073581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:40.092600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d87f-caaf-4ef6-ac9a-99df69c36665 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.122748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f231af-2b51-4a58-9ab1-455b9b88062c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.132872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.133889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.134186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.134464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.135149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.137332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.160635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 16/33] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 12:56:39 2022] POST /identity/v3/roles => generated 219 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:40.161606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:40.162288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.163154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.163690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.164166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] PATH_INFO: `/v3/users/7689dbdad16d4fd1b82041f0857674c0` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.165793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] RBAC: Authorizing `identity:get_user(user_id=7689dbdad16d4fd1b82041f0857674c0)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.167561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.169857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:39 2022] GET /identity/v3/users/7689dbdad16d4fd1b82041f0857674c0 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:40.170908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:40.287292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983eeb7-0374-411b-b0da-47a16f53edfc None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.304686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:40.333754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.334390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.334674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.334974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.335761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:40.336136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.337609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9828a-6892-4b95-a49b-e7ce87be9f3d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.343861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fdd2d-bd2b-4080-a0ee-808b1f08fb9f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.357700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:40.359665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d587c-9a4d-4747-bcc5-2e9817a8fa46 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.359665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d587c-9a4d-4747-bcc5-2e9817a8fa46 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.359850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d587c-9a4d-4747-bcc5-2e9817a8fa46 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.360968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:40.365769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d587c-9a4d-4747-bcc5-2e9817a8fa46 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:40.378520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:40.394288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.395333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.395644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.396285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.396976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.398413 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.528562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 12:56:40 2022] POST /identity/v3/roles => generated 225 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:40.529480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:40.594736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d587c-9a4d-4747-bcc5-2e9817a8fa46 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.634943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e8b01-3024-4587-b4a0-6dfa7ee70022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.635640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8b01-3024-4587-b4a0-6dfa7ee70022 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.636089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8b01-3024-4587-b4a0-6dfa7ee70022 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.636372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e8b01-3024-4587-b4a0-6dfa7ee70022 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.637548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e8b01-3024-4587-b4a0-6dfa7ee70022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.639055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e8b01-3024-4587-b4a0-6dfa7ee70022 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.640719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:40.641906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48cc8-4700-48df-925c-6adbc3f2aee6 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.642191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48cc8-4700-48df-925c-6adbc3f2aee6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.642469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48cc8-4700-48df-925c-6adbc3f2aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.654286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b762b60-96d0-4967-b9d3-1425c20b9eac None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.661245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-06f48cc8-4700-48df-925c-6adbc3f2aee6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:40.662470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-06f48cc8-4700-48df-925c-6adbc3f2aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:40.695141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16f524-1cf2-4648-8006-b8b4efb7d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.696115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16f524-1cf2-4648-8006-b8b4efb7d03d None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.696396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16f524-1cf2-4648-8006-b8b4efb7d03d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.696680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16f524-1cf2-4648-8006-b8b4efb7d03d None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.697388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16f524-1cf2-4648-8006-b8b4efb7d03d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.699025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16f524-1cf2-4648-8006-b8b4efb7d03d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.701011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:40.744749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:56:40 2022] POST /identity/v3/projects => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:40.745587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ccb2-bd5e-4e5c-b3a4-29ea462ba1cc None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.745878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ccb2-bd5e-4e5c-b3a4-29ea462ba1cc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.746162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ccb2-bd5e-4e5c-b3a4-29ea462ba1cc None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.747848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 21/40] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:40.748637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663ccb2-bd5e-4e5c-b3a4-29ea462ba1cc None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:40.763594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 20/41] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:40.765503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.766008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.766503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.802458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:40.805272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:40.818541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:40.891989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663ccb2-bd5e-4e5c-b3a4-29ea462ba1cc None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:40.912296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:40.934833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:40.935477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:40.935759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:40.936031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:40.936799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.domain.id=default, user.id=7689dbdad16d4fd1b82041f0857674c0) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:40.937217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:40.938535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:40.947839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Oct 13 12:56:40 2022] GET /identity/v3/role_assignments?user.id=7689dbdad16d4fd1b82041f0857674c0&scope.domain.id=default&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 530 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:41.040257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:41.144219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:41.146835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0520f24-a9b3-456e-b184-f5b1a61293fb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:41.184213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:41.185164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:41.185785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:41.186069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:41.186345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:41.187028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:41.188533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:41.202251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 12:56:41 2022] POST /identity/v3/roles => generated 223 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:41.289642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b1292-eb06-4320-b4b5-106042726f3a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:41.298228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:41.326812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f10f8f-7989-44f9-8021-7cca75ca7ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:41.327571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10f8f-7989-44f9-8021-7cca75ca7ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:41.327852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10f8f-7989-44f9-8021-7cca75ca7ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:41.328123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10f8f-7989-44f9-8021-7cca75ca7ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:41.329256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f10f8f-7989-44f9-8021-7cca75ca7ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:41.330723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f10f8f-7989-44f9-8021-7cca75ca7ad8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:41.332354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 23/45] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:41.338798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:41.439513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaabf6-0711-4ade-bd8c-241671a31773 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:41.472653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6d7a8-e730-4e6d-afc4-2dc6dd2e0058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:41.473266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6d7a8-e730-4e6d-afc4-2dc6dd2e0058 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:41.473549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6d7a8-e730-4e6d-afc4-2dc6dd2e0058 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:41.473827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6d7a8-e730-4e6d-afc4-2dc6dd2e0058 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:41.474489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6d7a8-e730-4e6d-afc4-2dc6dd2e0058 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:41.475989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6d7a8-e730-4e6d-afc4-2dc6dd2e0058 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:41.502456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:56:41 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:43.607215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305f3d-d949-461c-9834-44877dc74f2f None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:43.607758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305f3d-d949-461c-9834-44877dc74f2f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:43.607859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305f3d-d949-461c-9834-44877dc74f2f None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:43.609118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:43.614324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:43.614684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:43.614891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:43.633992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:43.635188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:43.642218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:43.699794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:43.963080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305f3d-d949-461c-9834-44877dc74f2f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:44.060086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305f3d-d949-461c-9834-44877dc74f2f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:44.092167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb3643-7595-4661-9c6f-82eedad15907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:44.092786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3643-7595-4661-9c6f-82eedad15907 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:44.093065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3643-7595-4661-9c6f-82eedad15907 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:44.093336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3643-7595-4661-9c6f-82eedad15907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:44.094427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb3643-7595-4661-9c6f-82eedad15907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:44.095899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb3643-7595-4661-9c6f-82eedad15907 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:44.097418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:44.103286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:44.196117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597e53c-c0e6-47a6-925d-b87b2fabac47 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:44.228770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78641-f29e-44f3-95a4-a39ee5931f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:44.229308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78641-f29e-44f3-95a4-a39ee5931f61 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:44.229591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78641-f29e-44f3-95a4-a39ee5931f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:44.229862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78641-f29e-44f3-95a4-a39ee5931f61 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:44.230513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78641-f29e-44f3-95a4-a39ee5931f61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:44.231982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78641-f29e-44f3-95a4-a39ee5931f61 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:44.245475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:44.256454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Oct 13 12:56:44 2022] POST /identity/v3/projects => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:46.349077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e736-f10f-4c65-951e-671f79f71a62 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:46.349609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e736-f10f-4c65-951e-671f79f71a62 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:46.349609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e736-f10f-4c65-951e-671f79f71a62 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:46.351007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 26/51] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:46.356192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:46.356601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:46.356752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:46.374996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:46.376216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:46.440210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 26/52] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:46.704743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e736-f10f-4c65-951e-671f79f71a62 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:46.748151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:46.803242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e736-f10f-4c65-951e-671f79f71a62 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:46.835089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae8f9-e96a-4d44-a141-7941046d05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:46.835775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae8f9-e96a-4d44-a141-7941046d05db None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:46.836054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae8f9-e96a-4d44-a141-7941046d05db None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:46.836324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae8f9-e96a-4d44-a141-7941046d05db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:46.837446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae8f9-e96a-4d44-a141-7941046d05db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:46.838887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae8f9-e96a-4d44-a141-7941046d05db None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:46.840463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:46.846057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:46.940213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd879-e012-49a8-b646-7418472e3391 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:46.962354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:46.972949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47310b03-7e84-46ff-9e0c-20af32f95c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:46.973544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310b03-7e84-46ff-9e0c-20af32f95c87 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:46.973824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310b03-7e84-46ff-9e0c-20af32f95c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:46.974097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47310b03-7e84-46ff-9e0c-20af32f95c87 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:46.974745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47310b03-7e84-46ff-9e0c-20af32f95c87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:46.976801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47310b03-7e84-46ff-9e0c-20af32f95c87 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:47.001450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 27/54] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:56:46 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 12:56:50.109886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06169b0c-e0a2-4dfd-bec8-c9de9d50a90b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.110401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06169b0c-e0a2-4dfd-bec8-c9de9d50a90b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.110479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06169b0c-e0a2-4dfd-bec8-c9de9d50a90b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.111834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 28/55] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:50.117669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f9f0-be8e-4c77-b330-a85352b5b547 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.118092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f9f0-be8e-4c77-b330-a85352b5b547 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.118230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f9f0-be8e-4c77-b330-a85352b5b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.156430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b519f9f0-be8e-4c77-b330-a85352b5b547 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:50.157648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b519f9f0-be8e-4c77-b330-a85352b5b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:50.255012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 28/56] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:56:50.331378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde672-cbfb-4a96-bc4a-6971b5180ece None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.332055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde672-cbfb-4a96-bc4a-6971b5180ece None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.332522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde672-cbfb-4a96-bc4a-6971b5180ece None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.334069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 29/57] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:50.339538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.340086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.340640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.360017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:50.361580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:50.434266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 29/58] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:50.717716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde672-cbfb-4a96-bc4a-6971b5180ece None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:50.730794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:50.800147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:50.859140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d92e-9af3-4313-b302-d2325c16b870 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:50.863841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde672-cbfb-4a96-bc4a-6971b5180ece None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:50.875868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:50.893125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd0be-aac4-4ccb-9a1e-2b2c312e5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:50.893765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd0be-aac4-4ccb-9a1e-2b2c312e5d2f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.894046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd0be-aac4-4ccb-9a1e-2b2c312e5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.894323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd0be-aac4-4ccb-9a1e-2b2c312e5d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.900865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039cc43-188b-4137-8f00-36e923f263f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:50.901507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039cc43-188b-4137-8f00-36e923f263f6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.901789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039cc43-188b-4137-8f00-36e923f263f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.902062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039cc43-188b-4137-8f00-36e923f263f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.905201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd0be-aac4-4ccb-9a1e-2b2c312e5d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-bb5dd0be-aac4-4ccb-9a1e-2b2c312e5d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:50.910107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:50.910937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:50.912024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:50.912864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220de3-2d0f-4680-ad54-31f3cfb5747f None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.913149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220de3-2d0f-4680-ad54-31f3cfb5747f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.913422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220de3-2d0f-4680-ad54-31f3cfb5747f None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.913957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039cc43-188b-4137-8f00-36e923f263f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 31/60] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff95e1-75c1-4a86-a510-13c20f80dfb6 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff95e1-75c1-4a86-a510-13c20f80dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff95e1-75c1-4a86-a510-13c20f80dfb6 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 32/61] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422079c-c63e-47f7-bbc8-e56d9bcc033d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:50.919249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422079c-c63e-47f7-bbc8-e56d9bcc033d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:50.919868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422079c-c63e-47f7-bbc8-e56d9bcc033d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:50.920106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 33/62] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:50.920820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422079c-c63e-47f7-bbc8-e56d9bcc033d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.023690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-8039cc43-188b-4137-8f00-36e923f263f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:51.027574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:51.028741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:51.029594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:51.030227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422079c-c63e-47f7-bbc8-e56d9bcc033d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.030292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 30/63] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:51.030292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756a87-592d-48da-86ba-ddb23ca8d53b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.030292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756a87-592d-48da-86ba-ddb23ca8d53b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.030470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756a87-592d-48da-86ba-ddb23ca8d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.048197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-21756a87-592d-48da-86ba-ddb23ca8d53b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:51.049715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-21756a87-592d-48da-86ba-ddb23ca8d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:51.066723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.067337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.067654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.067947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.068600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:51.068910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.070844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a953f-3330-4001-b13d-ec825501f07d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.078765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 34/64] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.080707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.080998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.081278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.098917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:51.100137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:51.122628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 31/65] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:51.124043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.124402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.124683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.150206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:51.151385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:51.172733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 35/66] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:51.174441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.229084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 32/67] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:51.232265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.291843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.324554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.340770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f128-ad40-43c7-b37f-d687e22ad769 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.402250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.402890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.403600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.403895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.404765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:51.405218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.406886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.410361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada3c3a-13c2-48c3-beb6-e902f062fbcd None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.417906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 36/68] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.419497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.449637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.450279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.450562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.450838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] PATH_INFO: `/v3/users/7689dbdad16d4fd1b82041f0857674c0` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.452014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] RBAC: Authorizing `identity:get_user(user_id=7689dbdad16d4fd1b82041f0857674c0)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.453478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.455192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 33/69] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/users/7689dbdad16d4fd1b82041f0857674c0 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.455830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.535846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e114f9-0a2b-4ada-9aa4-cf865919bea7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.558669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.562620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42408ff-7fa3-47e3-b185-43b279436444 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.572208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.572847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.573437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.573723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.583802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:51.590282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:51.591134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:51.591931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 37/70] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:51.592533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.598427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.599063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.599345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.599644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] PATH_INFO: `/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.611090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.614671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b59456f3476b9641e14cb5e4d2f3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.616192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.617811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 34/71] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.618576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.693721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6447-ceb6-46c6-941b-c919ac56a5fa None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.716895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4949-445a-47fe-9f60-ec7a98d9b639 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.727141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.727804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.728084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.728361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.738261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:51.743629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:51.744647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 38/72] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:51.745649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.754196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.754838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.755125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.755419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.756611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.758057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.764309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 35/73] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.764309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.786471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.818869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:51.843624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb564c1-34af-4536-a2fe-b63cb3a2cf5e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.859390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff986bf-2d7e-4d14-ab78-5c23a9a22aca None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.876185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.876805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.877082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.877354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.878437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.880026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.881576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 39/74] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.882326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.894121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:51.894731 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:51.895013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:51.895291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:51.895990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:51.896293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:51.897692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:51.909288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 36/75] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:51.912262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:51.978364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd176d9-10bf-4c40-a6e0-b4278fa79b02 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:51.995734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.010663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77e598-62b1-4c74-86a3-969f3c65a736 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.011062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.011711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.011987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.012265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.013376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.014833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.016480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 40/76] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:52.017224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.028931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.048574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.049189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.049475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.049756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.050421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:52.050728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.052154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.061051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 37/77] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:56:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:52.061896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.118225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44b9a-b3c3-45e8-9842-37f12ff62826 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.151167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.151841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.152124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.152393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e/users/7689dbdad16d4fd1b82041f0857674c0/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.154293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] RBAC: Authorizing `identity:create_grant(project_id=d01339a8c203487885efc6b1d726951e, user_id=7689dbdad16d4fd1b82041f0857674c0, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.155774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.158266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389a052-00d2-4222-a029-41c71c9e22e6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.169045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 41/78] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:56:52 2022] PUT /identity/v3/projects/d01339a8c203487885efc6b1d726951e/users/7689dbdad16d4fd1b82041f0857674c0/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:56:52.169832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.203112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.203969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.204321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.204686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.205424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.206944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.236738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 38/79] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:56:52 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:52.245212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.250405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.262270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.303678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb00616-3eff-4eb1-a0f8-dd72f3baeb59 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.348960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.349784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.350072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.350975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] PATH_INFO: `/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.352312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b59456f3476b9641e14cb5e4d2f3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.353902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.355621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 42/80] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:52 2022] GET /identity/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:52.356613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.374142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744393e-ae83-4a65-bf26-13c0a7bf8e57 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.415273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.416331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.416805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.417280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e/users/bcd9b59456f3476b9641e14cb5e4d2f3/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.419552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] RBAC: Authorizing `identity:create_grant(project_id=d01339a8c203487885efc6b1d726951e, user_id=bcd9b59456f3476b9641e14cb5e4d2f3, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.421323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.443502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 39/81] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:56:52 2022] PUT /identity/v3/projects/d01339a8c203487885efc6b1d726951e/users/bcd9b59456f3476b9641e14cb5e4d2f3/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:56:52.447722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.499939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442c932-0a63-42b5-9b6a-f8c6219378ea None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.524544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.556421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.557281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.557809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.558374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] PATH_INFO: `/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.560247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b59456f3476b9641e14cb5e4d2f3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.562612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.564866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 43/82] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:52 2022] GET /identity/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:52.571363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.579362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b7875-be5d-4936-9f36-567f8cc11746 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.585223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.623569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.624599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.625058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.625477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.626907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.628626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.630513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 40/83] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:52 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:52.637552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.721580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56aa1-ef30-4666-b4e6-6e505c37f842 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.765809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ad040-ffc1-4a80-9d7b-0e533c6b7584 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.789469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.790112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.790398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.790666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] PATH_INFO: `/v3/projects/a5d22f2f90cb45ca97cf06645914a07a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.791918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d22f2f90cb45ca97cf06645914a07a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.793539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.796202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 44/84] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:52 2022] GET /identity/v3/projects/a5d22f2f90cb45ca97cf06645914a07a => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:52.801857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:52.808191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.820561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c9d9e-7852-4dbf-942c-fba785624b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.821773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c9d9e-7852-4dbf-942c-fba785624b96 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.821773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c9d9e-7852-4dbf-942c-fba785624b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.822065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c9d9e-7852-4dbf-942c-fba785624b96 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e/users/bcd9b59456f3476b9641e14cb5e4d2f3/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.825899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c9d9e-7852-4dbf-942c-fba785624b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=d01339a8c203487885efc6b1d726951e, user_id=bcd9b59456f3476b9641e14cb5e4d2f3, role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.827689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c9d9e-7852-4dbf-942c-fba785624b96 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:52.846697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:56:52 2022] PUT /identity/v3/projects/d01339a8c203487885efc6b1d726951e/users/bcd9b59456f3476b9641e14cb5e4d2f3/roles/5777ac04a7a942daa22c6642ded5268a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:56:52.906972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:52.937624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1fb4f-4aa4-4a2f-a657-42ff9a42f593 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:52.978474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff989a8-e807-455a-9f36-c0d969d272c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:52.979593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff989a8-e807-455a-9f36-c0d969d272c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:52.980016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff989a8-e807-455a-9f36-c0d969d272c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:52.980433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff989a8-e807-455a-9f36-c0d969d272c1 None admin] PATH_INFO: `/v3/projects/a5d22f2f90cb45ca97cf06645914a07a/users/bcd9b59456f3476b9641e14cb5e4d2f3/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:52.982539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff989a8-e807-455a-9f36-c0d969d272c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d22f2f90cb45ca97cf06645914a07a, user_id=bcd9b59456f3476b9641e14cb5e4d2f3, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:52.984201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff989a8-e807-455a-9f36-c0d969d272c1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:53.009475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:56:52 2022] PUT /identity/v3/projects/a5d22f2f90cb45ca97cf06645914a07a/users/bcd9b59456f3476b9641e14cb5e4d2f3/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:56:55.032911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dd8c9-feec-499a-b388-05609cabf4d6 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.033898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dd8c9-feec-499a-b388-05609cabf4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.034384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dd8c9-feec-499a-b388-05609cabf4d6 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.036001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 42/87] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:55.041753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb693f-1ae4-4b1f-a639-b5731483f02b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.042136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb693f-1ae4-4b1f-a639-b5731483f02b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.042311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb693f-1ae4-4b1f-a639-b5731483f02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.072386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f3bb693f-1ae4-4b1f-a639-b5731483f02b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:55.073597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f3bb693f-1ae4-4b1f-a639-b5731483f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:55.142662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:55.402127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6936-77a1-4021-b8f8-07e93b9b2dc7 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.402798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6936-77a1-4021-b8f8-07e93b9b2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.403465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6936-77a1-4021-b8f8-07e93b9b2dc7 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.405687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 43/89] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:55.413444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.413734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.414075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.440221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:55.441417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:55.516869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:55.525891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 47/90] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:55.572968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6936-77a1-4021-b8f8-07e93b9b2dc7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:55.712195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6936-77a1-4021-b8f8-07e93b9b2dc7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:55.761782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e02a9-32bf-4d4d-960e-e8a508c855af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:55.762432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e02a9-32bf-4d4d-960e-e8a508c855af None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.762716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e02a9-32bf-4d4d-960e-e8a508c855af None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.762992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e02a9-32bf-4d4d-960e-e8a508c855af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.781435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e02a9-32bf-4d4d-960e-e8a508c855af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-b36e02a9-32bf-4d4d-960e-e8a508c855af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:55.786657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:55.787615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:55.788341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 44/91] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:55.795343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:55.870493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706226de-e9ef-4063-9d67-ff59c9c58aa1 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.870806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706226de-e9ef-4063-9d67-ff59c9c58aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.871068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706226de-e9ef-4063-9d67-ff59c9c58aa1 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.873688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 45/92] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:55.878202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9962c8-0fa7-492d-9494-faf4e70e81bd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:55.878491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9962c8-0fa7-492d-9494-faf4e70e81bd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:55.878764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9962c8-0fa7-492d-9494-faf4e70e81bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:55.916533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-9c9962c8-0fa7-492d-9494-faf4e70e81bd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:55.917798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9c9962c8-0fa7-492d-9494-faf4e70e81bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:55.958724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210662e-02b6-43c6-a270-8dbf584e70b3 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.010287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.030836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.031485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.031772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.032046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.032723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:56.033023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.034414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:56.043465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 48/93] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:56.046729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 46/94] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:56:56.048132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43c12a-026c-4ca1-ab23-a0972a1d33dd None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.048326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.048422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43c12a-026c-4ca1-ab23-a0972a1d33dd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.048696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43c12a-026c-4ca1-ab23-a0972a1d33dd None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.050313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 47/95] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:56.051225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421738cf-3690-4bce-b69b-5d14945fce85 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.051565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421738cf-3690-4bce-b69b-5d14945fce85 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.051822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421738cf-3690-4bce-b69b-5d14945fce85 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.053900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 48/96] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:56.058505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421738cf-3690-4bce-b69b-5d14945fce85 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.113530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.163775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0ac4-b8eb-4048-a3df-fa61b36cdcc3 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.191432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421738cf-3690-4bce-b69b-5d14945fce85 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.200547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e5e2a-547d-465b-b8b0-2b52babf3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.201266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e5e2a-547d-465b-b8b0-2b52babf3db3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.201622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e5e2a-547d-465b-b8b0-2b52babf3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.202334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e5e2a-547d-465b-b8b0-2b52babf3db3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.212973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e5e2a-547d-465b-b8b0-2b52babf3db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-ea9e5e2a-547d-465b-b8b0-2b52babf3db3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:56.218696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:56.219573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:56.220318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 49/97] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:56.221713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.222172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.222590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.236770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df05a13-d676-4836-b731-4cb750724a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.237905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05a13-d676-4836-b731-4cb750724a60 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.238356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05a13-d676-4836-b731-4cb750724a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.238770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05a13-d676-4836-b731-4cb750724a60 None admin] PATH_INFO: `/v3/users/7689dbdad16d4fd1b82041f0857674c0` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.240090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df05a13-d676-4836-b731-4cb750724a60 None admin] RBAC: Authorizing `identity:get_user(user_id=7689dbdad16d4fd1b82041f0857674c0)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.242199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:56.242371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df05a13-d676-4836-b731-4cb750724a60 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:56.243808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:56.244306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 49/98] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/users/7689dbdad16d4fd1b82041f0857674c0 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:56.245557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.245992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.246702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.270482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:56.272627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:56.317279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 50/99] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:56.318801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.345812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.363168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 50/100] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:56.367541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.403780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.468765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904de71d-e5d7-4eef-b22f-70c9a9c7a8c8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.505014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.505992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.506644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.507115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.511921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244d5fc-2ed0-4c1f-b302-d4bcfd087f83 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.562812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.585717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.587767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:56.630030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.630650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.630930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.631296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.632005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:56.632308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.633686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:56.642408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 51/101] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:56.643067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.694367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:56:56.695513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.745287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394150f-74b1-4f7d-a359-2030d9ee86e8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.754139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.776102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.779768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.780509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.780678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.780954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.782054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.783562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:56.785149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 52/103] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:56.785914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.798273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104ad0-3703-4867-9ccc-ecd78bcc4aa2 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.831157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40d83a-8dbe-4b11-9a25-e93b2c335b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.831825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40d83a-8dbe-4b11-9a25-e93b2c335b6d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.832087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40d83a-8dbe-4b11-9a25-e93b2c335b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.832358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40d83a-8dbe-4b11-9a25-e93b2c335b6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.842718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40d83a-8dbe-4b11-9a25-e93b2c335b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-9b40d83a-8dbe-4b11-9a25-e93b2c335b6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:56.847583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:56.848431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:56.849381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 52/104] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:56.853144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77753a5-9412-4df2-804b-9a65370773aa None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.853712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77753a5-9412-4df2-804b-9a65370773aa None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.854561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77753a5-9412-4df2-804b-9a65370773aa None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.855881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 53/105] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:56.856591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77753a5-9412-4df2-804b-9a65370773aa None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.884582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b405a3-cd7e-4c04-ac5d-e39a77556b8a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.917700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.918319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.918599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.918870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] PATH_INFO: `/v3/users/8c403a74279a462588fea3ac015ed4cc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.931969 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] RBAC: Authorizing `identity:get_user(user_id=8c403a74279a462588fea3ac015ed4cc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.933437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:56.935038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 53/106] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/users/8c403a74279a462588fea3ac015ed4cc => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:56.935824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:56.960293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77753a5-9412-4df2-804b-9a65370773aa None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:56.970784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:56.995018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:56.995683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:56.996022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:56.996302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:56.997422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:56.998885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.000546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 54/107] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.004290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.014703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.038428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f17e13-43aa-463a-9b35-a3ee1b5e88c1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.071722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.072352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.072638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.072916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.082944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:57.088378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:57.089221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:56:57.089950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 54/108] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:56:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:57.090589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.107351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69008ae4-bb54-47b4-960b-9c78cd05ef20 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.140467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac517-9f0d-4950-9cf6-a27c0797a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.141080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac517-9f0d-4950-9cf6-a27c0797a44c None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.141365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac517-9f0d-4950-9cf6-a27c0797a44c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.141640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac517-9f0d-4950-9cf6-a27c0797a44c None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.142286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cac517-9f0d-4950-9cf6-a27c0797a44c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.143763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cac517-9f0d-4950-9cf6-a27c0797a44c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.170199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 55/109] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:56:57 2022] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:56:57.170199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165ff40-409e-49bf-a070-7138531a666b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.170199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165ff40-409e-49bf-a070-7138531a666b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.170199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165ff40-409e-49bf-a070-7138531a666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.191387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.191387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5055a0a-60eb-47cc-81c4-6280aab50e55 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.207963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a165ff40-409e-49bf-a070-7138531a666b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:57.210290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a165ff40-409e-49bf-a070-7138531a666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:57.229101 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.229734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.230017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.230295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.230983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:57.231293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.232788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.242456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 55/110] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.243396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.279568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.293295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 56/111] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:57.300754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165ff40-409e-49bf-a070-7138531a666b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.361521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a847c08-edca-4bd6-96f8-5d7dc062e979 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.409749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.410495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.410784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.411062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.412927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.414847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.419834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 56/112] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.419834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.435258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165ff40-409e-49bf-a070-7138531a666b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.446796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.482511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.483376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.483690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.484377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.485390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=d01339a8c203487885efc6b1d726951e, user.id=7689dbdad16d4fd1b82041f0857674c0) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:57.485761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.487508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.496617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 57/113] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/role_assignments?user.id=7689dbdad16d4fd1b82041f0857674c0&scope.project.id=d01339a8c203487885efc6b1d726951e&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.498119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.527686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ff519-a040-4b1d-a764-5b91568159b1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.577342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.577971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.578285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.578550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.579250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:57.579590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.583453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.583968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.593118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 57/114] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.598476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.645356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c796f-ff64-4f23-a367-4366da841f28 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.683169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.684167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.684451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.684782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] PATH_INFO: `/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.686005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b59456f3476b9641e14cb5e4d2f3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.687527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.689189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 58/115] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.689989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.713849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.730536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0fc34-96d0-49a1-a297-3fa6cd912e7d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.774614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.775558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.775847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.776949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e/users/8c403a74279a462588fea3ac015ed4cc/roles/763e5f65333e4cf38530b8c23563ad18` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.779178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] RBAC: Authorizing `identity:create_grant(project_id=d01339a8c203487885efc6b1d726951e, user_id=8c403a74279a462588fea3ac015ed4cc, role_id=763e5f65333e4cf38530b8c23563ad18)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.780695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.799600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 58/116] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:56:57 2022] PUT /identity/v3/projects/d01339a8c203487885efc6b1d726951e/users/8c403a74279a462588fea3ac015ed4cc/roles/763e5f65333e4cf38530b8c23563ad18 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:56:57.804356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.818205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f9369-b4b7-4fc2-93d0-e683a11cffde None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.855826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:57.860208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.860833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.861127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.861542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.875533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:56:57.880975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:56:57.882425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:56:57.883155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 59/117] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:56:57.883815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:57.941865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f5a7-a919-402b-93eb-937c9f1faf31 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:57.988710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:57.989695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:57.990177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:57.990674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] PATH_INFO: `/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:57.992144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b59456f3476b9641e14cb5e4d2f3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:57.993938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:57.996357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 59/118] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:57.997329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.016220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.016866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4359-53b9-42fd-820c-bab75d5caeb8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.063487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.064121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.064458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.064738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.117423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733f302-068f-4fb7-b868-118b574f2817 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.133710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.156728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.157618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.158045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.158513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.158753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.159510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:58.159975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.160286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.161635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.171614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 60/119] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:58.172808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.260317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.271046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 60/120] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:56:58.272559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.289071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab3c2-28fa-47f8-bbd2-634dbf1704e1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.326257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.327211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.327760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.328232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.356287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.374966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5990b-4911-4709-9958-9e9ac8a5aec1 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.405588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.407376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.410022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.411046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.411046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.411307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] PATH_INFO: `/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.413052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b59456f3476b9641e14cb5e4d2f3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.414508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.416489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 61/121] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/users/bcd9b59456f3476b9641e14cb5e4d2f3 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:58.417624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.493739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.521347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1083e8-4214-42c4-8ff8-bc749d6a534e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.522765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 61/122] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:56:58.523834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.562441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.563088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.563372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.563681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.564817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.566299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.568341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 62/123] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:58.569954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.599966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.643760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443134-16a2-40c5-898d-a85269e76aa4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.674005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2750f38-37b2-4c66-bae7-8698b84a38fe None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.679315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.680357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.680824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.681303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.713885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.713885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.713885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.713885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.714479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.717078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.717598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 63/124] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:58.723720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.740274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.765793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.767585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.810969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:58.826772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1716-a2c3-43b9-ba7f-74f95837f7f5 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:58.860976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:58.861592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:58.861875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:58.862153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:58.863197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] RBAC: Adding query filter params (role.id=c4d52d7819e647bcbe57fa726e019998, scope.project.id=d01339a8c203487885efc6b1d726951e, user.id=bcd9b59456f3476b9641e14cb5e4d2f3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:58.863197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:58.864649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:58.880802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 64/126] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/role_assignments?user.id=bcd9b59456f3476b9641e14cb5e4d2f3&scope.project.id=d01339a8c203487885efc6b1d726951e&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:58.880802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.881657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 62/126] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:56:58.882765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:58.966614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:59.003107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b403-e327-420f-9fa9-5745b539970a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:59.073745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc57850-c876-4a4c-a44d-9741b3b697f9 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:59.076634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:59.077530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:59.077966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:59.078379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] PATH_INFO: `/v3/projects/a5d22f2f90cb45ca97cf06645914a07a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:59.080136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d22f2f90cb45ca97cf06645914a07a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:59.082612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:59.084998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 63/127] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/projects/a5d22f2f90cb45ca97cf06645914a07a => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:59.096258 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:59.126440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:59.127605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:59.128123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:59.128609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:59.129530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] RBAC: Adding query filter params (role.id=5777ac04a7a942daa22c6642ded5268a, scope.project.id=d01339a8c203487885efc6b1d726951e, user.id=bcd9b59456f3476b9641e14cb5e4d2f3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:59.130028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:59.132452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8ac23-336c-4d1e-990a-14ab8c600b3a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:59.138920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 65/128] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:56:58 2022] GET /identity/v3/role_assignments?user.id=bcd9b59456f3476b9641e14cb5e4d2f3&scope.project.id=d01339a8c203487885efc6b1d726951e&role.id=5777ac04a7a942daa22c6642ded5268a => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:56:59.233538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af93d5-0fd8-4d40-9d48-0029e0d837c9 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:56:59.280847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:56:59.281846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:59.282325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:59.282815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:59.283866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] RBAC: Adding query filter params (role.id=c4d52d7819e647bcbe57fa726e019998, scope.project.id=a5d22f2f90cb45ca97cf06645914a07a, user.id=bcd9b59456f3476b9641e14cb5e4d2f3) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:56:59.284376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:56:59.286047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8660f3-af45-47f1-a8a7-a21d864fd8c5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:56:59.295179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 64/129] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:56:59 2022] GET /identity/v3/role_assignments?user.id=bcd9b59456f3476b9641e14cb5e4d2f3&scope.project.id=a5d22f2f90cb45ca97cf06645914a07a&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:56:59.579725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9657-39fd-4c27-9369-a9aabe064c69 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:59.580019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9657-39fd-4c27-9369-a9aabe064c69 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:59.580293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9657-39fd-4c27-9369-a9aabe064c69 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:59.581651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 66/130] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:56:59.586971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7f5a2-4e63-423b-89b9-7218af7a89cf None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:56:59.587259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7f5a2-4e63-423b-89b9-7218af7a89cf None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:56:59.587565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7f5a2-4e63-423b-89b9-7218af7a89cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:56:59.605947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-49d7f5a2-4e63-423b-89b9-7218af7a89cf None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:56:59.607121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-49d7f5a2-4e63-423b-89b9-7218af7a89cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:56:59.609098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:56:59.673035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 65/131] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:56:59.942366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9657-39fd-4c27-9369-a9aabe064c69 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:56:59.957930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:00.020156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054cd7-0cad-4a33-82fe-121092fd1d19 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.020435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054cd7-0cad-4a33-82fe-121092fd1d19 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.020711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054cd7-0cad-4a33-82fe-121092fd1d19 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.022658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 66/132] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:00.027511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.027792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.028065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.043159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9657-39fd-4c27-9369-a9aabe064c69 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:00.045852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:00.047037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:00.076935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:00.077557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.077833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.078106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.079248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:00.080722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:00.082266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 67/133] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:56:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:00.088365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:00.112921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 67/134] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:00.166615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:00.184301 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213b56-422d-4851-b1a7-24002af59585 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:00.217253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:00.217798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.218077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.218355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.219000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:00.220497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:00.240321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 68/135] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:00 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:00.379754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:00.448738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:00.481991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb1818-ce19-426b-ad12-dea71cf4aa7b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:00.518858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:00.519520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.519801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.520074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.530712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:00.535672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:00.536480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:00.537242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 68/136] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:00.542737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:00.653315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409bb9-0d07-4bfe-bca8-3cb7ee0d4c5d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:00.689942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:00.690563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.690841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.691112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.691824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:00.692129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:00.694755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:00.700036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:00.707485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 69/137] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:00.710301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:00.823044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7cfb6-fb64-44a5-b70d-820ff9b4b20d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:00.849654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:00.858889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:00.859555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:00.859836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:00.860115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] PATH_INFO: `/v3/users/8c403a74279a462588fea3ac015ed4cc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:00.861242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] RBAC: Authorizing `identity:get_user(user_id=8c403a74279a462588fea3ac015ed4cc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:00.862714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:00.864626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 69/138] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:00 2022] GET /identity/v3/users/8c403a74279a462588fea3ac015ed4cc => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:00.870561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:00.975777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd953-8237-4e79-9fde-9dd086814c08 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:01.014813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:01.015462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:01.015747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:01.016021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:01.086978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:01.089058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:01.090788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:01.192577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:01.198194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:01.302388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc795ed-a6fa-4da3-84bd-038c699afd2c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:01.337127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1edf58-b27d-4af2-a7ea-6ad9a37c9c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:01.337740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edf58-b27d-4af2-a7ea-6ad9a37c9c70 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:01.338022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edf58-b27d-4af2-a7ea-6ad9a37c9c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:01.338290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edf58-b27d-4af2-a7ea-6ad9a37c9c70 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:01.339432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1edf58-b27d-4af2-a7ea-6ad9a37c9c70 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:01.340898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1edf58-b27d-4af2-a7ea-6ad9a37c9c70 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:01.342540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 70/140] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:01 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:01.348498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:01.450082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:01.455945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29439-3068-4ccf-84f3-aa05b8540747 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:01.489880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:01.491010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:01.491290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:01.491594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:01.492315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] RBAC: Adding query filter params (role.id=763e5f65333e4cf38530b8c23563ad18, scope.project.id=d01339a8c203487885efc6b1d726951e, user.id=8c403a74279a462588fea3ac015ed4cc) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:01.492623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:01.494080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40fda4-2eae-4174-8485-1d1c9b588d51 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:01.500035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 71/141] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:01 2022] GET /identity/v3/role_assignments?user.id=8c403a74279a462588fea3ac015ed4cc&scope.project.id=d01339a8c203487885efc6b1d726951e&role.id=763e5f65333e4cf38530b8c23563ad18 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:02.577540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329560f2-28a3-4d4b-9d6e-a5dad55729ec None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:02.578045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329560f2-28a3-4d4b-9d6e-a5dad55729ec None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:02.578119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329560f2-28a3-4d4b-9d6e-a5dad55729ec None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:02.579446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 71/142] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:02.585151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f993c-b5ba-4fce-a04c-082670f5175a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:02.585569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f993c-b5ba-4fce-a04c-082670f5175a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:02.585738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f993c-b5ba-4fce-a04c-082670f5175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:02.605538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ac7f993c-b5ba-4fce-a04c-082670f5175a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:02.606731 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ac7f993c-b5ba-4fce-a04c-082670f5175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:02.663715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90e480-a687-4fd7-b6a0-913049b1661c None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:02.664140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90e480-a687-4fd7-b6a0-913049b1661c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:02.664490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90e480-a687-4fd7-b6a0-913049b1661c None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:02.665924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 72/143] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:02.670820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85141-0543-4646-af14-11715b712a77 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:02.671106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85141-0543-4646-af14-11715b712a77 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:02.671509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85141-0543-4646-af14-11715b712a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:02.676530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 72/144] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:02.692602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3cb85141-0543-4646-af14-11715b712a77 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:02.694473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3cb85141-0543-4646-af14-11715b712a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:02.767457 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:02.777215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 73/145] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:02.816296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d0d9-b844-45cd-a6b6-d9ec2519c143 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:02.816898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d0d9-b844-45cd-a6b6-d9ec2519c143 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:02.817372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d0d9-b844-45cd-a6b6-d9ec2519c143 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:02.819196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 73/146] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:02.824330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:02.824623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:02.824896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:02.842976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:02.844136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:02.910229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 74/147] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:02.947243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d0d9-b844-45cd-a6b6-d9ec2519c143 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.040881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.049598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d0d9-b844-45cd-a6b6-d9ec2519c143 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.050586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.087208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.087899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.088769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.088769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.099440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:03.104923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:03.105744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:03.106501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 74/148] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:03.111774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.156827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b771af1-32e3-4c24-80e5-a9fd137de6bd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.182080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.193999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.194628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.194906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.195176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.204911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:03.209882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:03.210798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:03.211874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 75/149] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:03.216295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.216427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c967e7a-e2c8-4496-9c45-a62b7fd2ca3a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.249495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.250095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.250374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.250641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.251300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:03.251630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.253012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.261048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 75/150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:03.261848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.278715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.317249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42020df-2645-4f10-81df-57833594bc84 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.350775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.351377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.351716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.352018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.353155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.354637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.356246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 76/151] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:03.357074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.364117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba3c9b-4c73-4607-b7aa-a39f89f0a832 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.397572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.398185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.398470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.398741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.399421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:03.399728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.401093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.408945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.409144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 76/152] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:03.409919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.459485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca707bb4-3b8d-4323-82cd-ac9f44d821a9 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.485525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.492971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.493599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.493877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.494148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] PATH_INFO: `/v3/users/8362d6fe59f04e319956fc93b2becbdc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.507565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ead3d-a105-4b7a-86c2-aabbeacf631e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.507956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] RBAC: Authorizing `identity:get_user(user_id=8362d6fe59f04e319956fc93b2becbdc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.509425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.511045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 77/153] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/users/8362d6fe59f04e319956fc93b2becbdc => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:03.516253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.540304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.540906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.541187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.541456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.542092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.543544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.565667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 77/154] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:03 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:03.566463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.622879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e43a9-3205-42c8-8856-dbc141768827 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.636492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.665025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.665852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.666222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.666480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] PATH_INFO: `/v3/users/8362d6fe59f04e319956fc93b2becbdc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.667685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] RBAC: Authorizing `identity:get_user(user_id=8362d6fe59f04e319956fc93b2becbdc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.669349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.670999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 78/155] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/users/8362d6fe59f04e319956fc93b2becbdc => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:03.676548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.684889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033e656-2f7b-4f14-ac36-e1171ab6f295 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.726991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.728271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.728553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.729177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.730463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.731977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.733631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 78/156] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:03.739331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.742782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.804508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edb9b-790d-4e15-bd5e-ab1d184d69d3 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.845074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.845696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.846353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.846353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.847466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.849081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.851624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 79/157] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:03 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:03.857750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:03.864648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f6532-939f-4bc9-b6b2-951f97a75eb5 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:03.914123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52399fef-c663-4eb4-b9c4-3f0c09d4f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:03.914862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52399fef-c663-4eb4-b9c4-3f0c09d4f08d None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:03.915273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52399fef-c663-4eb4-b9c4-3f0c09d4f08d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:03.915614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52399fef-c663-4eb4-b9c4-3f0c09d4f08d None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/8362d6fe59f04e319956fc93b2becbdc/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:03.917747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52399fef-c663-4eb4-b9c4-3f0c09d4f08d None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb57d06fbbf4501b56a504649f843b8, user_id=8362d6fe59f04e319956fc93b2becbdc, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:03.918336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:03.919924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52399fef-c663-4eb4-b9c4-3f0c09d4f08d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:03.939450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 79/158] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:03 2022] PUT /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/8362d6fe59f04e319956fc93b2becbdc/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 12:57:03.988306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c756bc-37cc-4bc2-957a-403baf523cfd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:04.029044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6422-ca68-4b85-8e4c-93d88c5aef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:04.029729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6422-ca68-4b85-8e4c-93d88c5aef71 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:04.030073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6422-ca68-4b85-8e4c-93d88c5aef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:04.030353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6422-ca68-4b85-8e4c-93d88c5aef71 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/8362d6fe59f04e319956fc93b2becbdc/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:04.032678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6422-ca68-4b85-8e4c-93d88c5aef71 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb57d06fbbf4501b56a504649f843b8, user_id=8362d6fe59f04e319956fc93b2becbdc, role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:04.034249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6422-ca68-4b85-8e4c-93d88c5aef71 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:04.050474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 80/159] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:03 2022] PUT /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/8362d6fe59f04e319956fc93b2becbdc/roles/5777ac04a7a942daa22c6642ded5268a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:05.859076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2eabe-43c3-4932-ad5c-a2f18d0fc650 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:05.859677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2eabe-43c3-4932-ad5c-a2f18d0fc650 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:05.859770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2eabe-43c3-4932-ad5c-a2f18d0fc650 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:05.861093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 80/160] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:05.866367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c49102-a7b4-4ded-bdf3-de689cb62709 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:05.866799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c49102-a7b4-4ded-bdf3-de689cb62709 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:05.866988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c49102-a7b4-4ded-bdf3-de689cb62709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:05.885433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-36c49102-a7b4-4ded-bdf3-de689cb62709 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:05.886626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-36c49102-a7b4-4ded-bdf3-de689cb62709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:05.930022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628a30-09bb-4626-a0ae-90a4f67ded45 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:05.930306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628a30-09bb-4626-a0ae-90a4f67ded45 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:05.930585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628a30-09bb-4626-a0ae-90a4f67ded45 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:05.931967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 81/161] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:05.937272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c9cb-08ae-401d-a12a-1b6f641cc6cc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:05.937551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c9cb-08ae-401d-a12a-1b6f641cc6cc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:05.937823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c9cb-08ae-401d-a12a-1b6f641cc6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:05.960719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 81/162] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:05.963362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-5621c9cb-08ae-401d-a12a-1b6f641cc6cc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:05.964607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5621c9cb-08ae-401d-a12a-1b6f641cc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:06.024843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.038574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 82/163] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:06.162072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390af15f-6465-424f-9962-7e85e8dfd79b None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.162756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390af15f-6465-424f-9962-7e85e8dfd79b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.163257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390af15f-6465-424f-9962-7e85e8dfd79b None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.164854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 82/164] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:06.170159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24633d-a3b0-4315-9213-99afc45567bc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.170447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24633d-a3b0-4315-9213-99afc45567bc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.170723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24633d-a3b0-4315-9213-99afc45567bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.189120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-fa24633d-a3b0-4315-9213-99afc45567bc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:06.190295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fa24633d-a3b0-4315-9213-99afc45567bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:06.231450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f60a1-676a-4801-98c5-ff7fdac032f6 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.231450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f60a1-676a-4801-98c5-ff7fdac032f6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.231450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f60a1-676a-4801-98c5-ff7fdac032f6 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.231450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 83/165] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:06.231975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f60a1-676a-4801-98c5-ff7fdac032f6 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.261568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 83/166] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:06.263060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.263336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.267941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.269463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.294352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:06.296562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:06.342393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f60a1-676a-4801-98c5-ff7fdac032f6 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.372590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 84/167] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:06.373694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.385637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.386564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.387055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.387566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.399221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:06.404678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:06.405670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:06.406586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:06.409179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 84/168] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:06.415145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.444036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.496995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6e453-d2b3-4eec-b76d-674494171c4b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.527260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.532996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943a8f3-d37b-4b5b-8227-e2f9ccffa054 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.535167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.536032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.536516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.536794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.537940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:06.539454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:06.541035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 85/169] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:06.543019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.569287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.569812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.570092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.570347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.571018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:06.571313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:06.572705 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:06.580982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 85/170] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:06.581740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.653709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924a9a-9ba2-4f6b-8641-7b5e9c0345d0 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.676587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.691065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14bfae-cb6f-4447-ba4f-53c6d25cdb2c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.691638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.692269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.692550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.692820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.703199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:06.708505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:06.709431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:06.710227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 86/171] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:06.711090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.727198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.727838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.728144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.728414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.729059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:06.730515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:06.750293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 86/172] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:06 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:06.751318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.768438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.828681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f234316-efde-4bb2-926c-9657837d5c85 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.865829 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.866501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.866858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.867140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] PATH_INFO: `/v3/users/216797939ae9451986ce617f2ce158a7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.870946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820042-e017-483f-b53c-bb9639526db5 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:06.882160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] RBAC: Authorizing `identity:get_user(user_id=216797939ae9451986ce617f2ce158a7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:06.883701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:06.885602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 87/173] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/users/216797939ae9451986ce617f2ce158a7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:06.886297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:06.914767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:06.915860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:06.916322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:06.916591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:06.930636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:06.932694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:06.936504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:06.937401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:06.938198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 87/174] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:06.938866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.002819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055b18-3959-4ad2-b286-248793716574 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.033188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.047099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.047771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.048051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.048325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.049330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:07.049330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.051558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.061208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 88/175] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:07.062125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.071908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1392387-f59e-4e65-b09b-fc16ecd1e76b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.114798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.115961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.116248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.116587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.117748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.119226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.120988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 88/176] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:06 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:07.121760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.193852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.198513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13c974-6d31-4307-8a10-8ca64153f05f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.240635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f64b18-a823-4b77-a711-48d0ca29aea7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.250409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.251039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.251753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.252044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.253015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:07.253331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.255655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.267100 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 89/177] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:07.272969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.280601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.281238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.281520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.281796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] PATH_INFO: `/v3/users/8362d6fe59f04e319956fc93b2becbdc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.282920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] RBAC: Authorizing `identity:get_user(user_id=8362d6fe59f04e319956fc93b2becbdc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.284438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.286302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 89/178] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/users/8362d6fe59f04e319956fc93b2becbdc => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:07.287580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.300653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.378396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3276e62-4577-495e-8abe-d49992116bf7 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.395443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503997c-f082-481a-adea-8d6435a1dd89 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.414556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.415226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.415531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.415812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/216797939ae9451986ce617f2ce158a7/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.417838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb57d06fbbf4501b56a504649f843b8, user_id=216797939ae9451986ce617f2ce158a7, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.419314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.435226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.435588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 90/179] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:07 2022] PUT /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/216797939ae9451986ce617f2ce158a7/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:07.436489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.440141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.440433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.441427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] PATH_INFO: `/v3/users/8362d6fe59f04e319956fc93b2becbdc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.442069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8362d6fe59f04e319956fc93b2becbdc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.444857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.448096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 90/180] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/users/8362d6fe59f04e319956fc93b2becbdc => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:07.456188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.505373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.606501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.631978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90bf2-e4f2-42db-8871-072e63fc52b6 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.658083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185d61-823c-43eb-a945-8e1ee160ee34 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.671259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.671852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.672135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.672411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.698420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:07.699046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:07.699316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:07.699609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:07.750352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.752054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.772379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:07.773859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:07.798099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.836920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:07.860932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 91/181] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:07.866538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.884516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 91/182] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:07.890346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:07.970311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246e06-ea17-426d-a20c-faf691fa72b2 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:07.998168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc02e-0e98-4230-903f-ef7224b6b8b3 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:08.005083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:08.006269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:08.006560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:08.006831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:08.008254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:08.009554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:08.011198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 92/183] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:08.016954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:08.024976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:08.037617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:08.038527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:08.039016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:08.039534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:08.040898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:08.042757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:08.045098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 92/184] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:07 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:08.051629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:08.107716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:08.198108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61281e-e43a-41a1-b9eb-21e192a783ef None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:08.227897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada4c1-164c-41bf-84dd-caadffc618a1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:08.233853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:08.234729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:08.235224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:08.235708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:08.237462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=7eb57d06fbbf4501b56a504649f843b8, user.id=8362d6fe59f04e319956fc93b2becbdc) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:08.237983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:08.239732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44021d5-652e-4064-afa3-1271030bfdf6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:08.247468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 93/185] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:08 2022] GET /identity/v3/role_assignments?user.id=8362d6fe59f04e319956fc93b2becbdc&scope.project.id=7eb57d06fbbf4501b56a504649f843b8&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:08.280333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:08.281293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:08.281768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:08.282233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:08.283176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] RBAC: Adding query filter params (role.id=5777ac04a7a942daa22c6642ded5268a, scope.project.id=7eb57d06fbbf4501b56a504649f843b8, user.id=8362d6fe59f04e319956fc93b2becbdc) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:08.283720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:08.285355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491ae83-76a9-40bd-a400-c34c0cdd06f3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:08.292348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 93/186] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:08 2022] GET /identity/v3/role_assignments?user.id=8362d6fe59f04e319956fc93b2becbdc&scope.project.id=7eb57d06fbbf4501b56a504649f843b8&role.id=5777ac04a7a942daa22c6642ded5268a => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:09.216083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767148ed-3d4f-45b6-a391-ac762918f29b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.216620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767148ed-3d4f-45b6-a391-ac762918f29b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.216620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767148ed-3d4f-45b6-a391-ac762918f29b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.218116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 94/187] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:09.223781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161544-6d38-43f0-8a58-89b0894e961b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.223907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.224248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161544-6d38-43f0-8a58-89b0894e961b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.224366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.224442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161544-6d38-43f0-8a58-89b0894e961b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.224513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.225660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 95/188] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:09.230383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.230661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.230937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.242531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:09.243763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:09.248280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:09.249436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:09.303170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:09.313454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:09.324154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 96/190] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:09.578460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:09.593009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:09.624704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:09.689351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f0be8-59d0-4798-a237-a0b751927d1e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:09.696455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb8681-3861-478f-bab2-20b005ae4e9b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:09.731634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:09.732379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.732658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:09.732769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.732945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.733285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.733562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.733832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.734025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:09.735716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:09.742153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:09.743047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:09.744626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:09.749537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:09.750394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:09.751170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 97/192] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:09.757461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:09.805997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:09.853793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b4b8b-b9e5-48b2-a4ff-89ae2b164186 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:09.865559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:09.869809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52486-e17b-47fd-bf5b-a6d4bd9e5449 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:09.893409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:09.894014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.894288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.894560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.895276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:09.896761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:09.908779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:09.908779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.909039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.909412 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.910041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:09.910384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:09.912088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a30e0-900d-4d09-97d0-86e093175650 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:09.928086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 96/193] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:09 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:09.931525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:09.937432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:09.959899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5d10-d4fa-467b-a52b-a1b3c0ddb074 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.960276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5d10-d4fa-467b-a52b-a1b3c0ddb074 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.960562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5d10-d4fa-467b-a52b-a1b3c0ddb074 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.962572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 99/195] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:09.968859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2aedc-113e-4403-8556-5240287515af None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:09.969495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2aedc-113e-4403-8556-5240287515af None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:09.969775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2aedc-113e-4403-8556-5240287515af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:09.988697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-27a2aedc-113e-4403-8556-5240287515af None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:09.990479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-27a2aedc-113e-4403-8556-5240287515af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:10.053581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a82b-b234-412e-a4d1-3c82e7a0702b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:10.075739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 100/196] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:10.091046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:10.091719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:10.092002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:10.092273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] PATH_INFO: `/v3/users/fbd6ca2632d34a409b2069961159457f` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:10.108667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] RBAC: Authorizing `identity:get_user(user_id=fbd6ca2632d34a409b2069961159457f)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:10.110096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:10.112117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 97/197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:09 2022] GET /identity/v3/users/fbd6ca2632d34a409b2069961159457f => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:10.117945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2aedc-113e-4403-8556-5240287515af None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:10.156394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:10.228820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2aedc-113e-4403-8556-5240287515af None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:10.268952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:10.269833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:10.270256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:10.270694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:10.272134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:10.273577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:10.275396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 101/198] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:10 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:10.283320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:10.310200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:10.341626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:10.397616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5928-eb46-44aa-9d6a-4daa406de72c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:10.436560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:10.437529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:10.438014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:10.438474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/fbd6ca2632d34a409b2069961159457f/roles/763e5f65333e4cf38530b8c23563ad18` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:10.440767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb57d06fbbf4501b56a504649f843b8, user_id=fbd6ca2632d34a409b2069961159457f, role_id=763e5f65333e4cf38530b8c23563ad18)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:10.442416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:10.463911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 98/199] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:10 2022] PUT /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8/users/fbd6ca2632d34a409b2069961159457f/roles/763e5f65333e4cf38530b8c23563ad18 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:10.478903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570bc2e-bfbf-424a-a078-8b7849ec3134 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:10.481601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:10.518881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:10.519873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:10.520295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:10.520742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:10.533810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:10.540249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:10.541396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:10.542339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:10.544791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 102/200] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:10.553498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:10.645633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:10.666759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc839fd-0bd5-42f5-9632-173ea032c835 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:10.702578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:10.703189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:10.703493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:10.703813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:10.704435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:10.704740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:10.706113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:10.715524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 99/201] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:10.721010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:10.830128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c755f15-405d-4b10-a223-1b6d8c76da2a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:10.867661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:10.868646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:10.869150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:10.869619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] PATH_INFO: `/v3/users/216797939ae9451986ce617f2ce158a7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:10.870980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] RBAC: Authorizing `identity:get_user(user_id=216797939ae9451986ce617f2ce158a7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:10.872683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:10.874770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 103/202] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:10 2022] GET /identity/v3/users/216797939ae9451986ce617f2ce158a7 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:10.880109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:10.983502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091596a9-2d84-4462-aab4-4a5778ace3e1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:11.022823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:11.023815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:11.024298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:11.024793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:11.039900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:11.092978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:11.094443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:11.194708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 100/203] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:11.197736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:11.231468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:11.307348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a5f8f-6523-43ee-a47e-39ac2a780b99 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:11.346474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11284b8-5fe0-4802-8aa3-894baab2a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:11.347120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11284b8-5fe0-4802-8aa3-894baab2a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:11.347419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11284b8-5fe0-4802-8aa3-894baab2a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:11.347712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11284b8-5fe0-4802-8aa3-894baab2a3e4 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:11.348855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11284b8-5fe0-4802-8aa3-894baab2a3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:11.350890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11284b8-5fe0-4802-8aa3-894baab2a3e4 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:11.352754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 104/204] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:11 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:11.358649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:11.404242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:11.461178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca1c1e-5fdc-49f6-83f2-57939149ad78 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:11.502419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:11.503028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:11.503304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:11.503614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:11.504339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] RBAC: Adding query filter params (role.id=c4d52d7819e647bcbe57fa726e019998, scope.project.id=7eb57d06fbbf4501b56a504649f843b8, user.id=216797939ae9451986ce617f2ce158a7) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:11.504652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:11.506113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85376adf-b3ec-42f8-a0da-502f1e96bfc6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:11.512189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 101/205] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:11 2022] GET /identity/v3/role_assignments?user.id=216797939ae9451986ce617f2ce158a7&scope.project.id=7eb57d06fbbf4501b56a504649f843b8&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:12.270038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e29a6-fd88-4548-b46f-0f1e4dfd012b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.270547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e29a6-fd88-4548-b46f-0f1e4dfd012b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.270622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e29a6-fd88-4548-b46f-0f1e4dfd012b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.272036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 105/206] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:12.277178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.277475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.277752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.295799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:12.296984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:12.317984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9336-3e65-4224-9cfd-8f4b1144a003 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.319103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9336-3e65-4224-9cfd-8f4b1144a003 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.319103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9336-3e65-4224-9cfd-8f4b1144a003 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.320528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 106/207] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:12.325332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.325621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.325895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.343769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:12.344961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:12.365948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 102/208] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:12.414196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 107/209] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:12.634522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:12.678581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:12.684835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:12.716391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:12.744046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17239e8-3ee0-4b48-a582-55a6e34ce24a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:12.777270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2f29f-fc91-46fa-b4f1-1cbed848faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:12.777893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2f29f-fc91-46fa-b4f1-1cbed848faeb None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.778177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2f29f-fc91-46fa-b4f1-1cbed848faeb None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.778445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2f29f-fc91-46fa-b4f1-1cbed848faeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.788536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2f29f-fc91-46fa-b4f1-1cbed848faeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:12.789894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6464-d485-41d6-bfd7-61e4bfa1684d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-eba2f29f-fc91-46fa-b4f1-1cbed848faeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:12.793345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:12.794387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:12.795263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 103/210] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:12.796029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15108-5af9-471a-8a58-56ef0af7e12c None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.796500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15108-5af9-471a-8a58-56ef0af7e12c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.796500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15108-5af9-471a-8a58-56ef0af7e12c None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.798343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 104/211] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:12.800233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15108-5af9-471a-8a58-56ef0af7e12c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:12.823692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c09c-49fa-40f3-90e8-600e43ed3ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:12.824324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c09c-49fa-40f3-90e8-600e43ed3ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.824601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c09c-49fa-40f3-90e8-600e43ed3ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.824880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c09c-49fa-40f3-90e8-600e43ed3ff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.825978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c09c-49fa-40f3-90e8-600e43ed3ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:12.827425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c09c-49fa-40f3-90e8-600e43ed3ff2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:12.828991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 108/212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:12.830078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.830356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.830627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.848752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:12.850550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:12.897568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:12.902391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15108-5af9-471a-8a58-56ef0af7e12c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:12.913588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 109/213] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:12.916269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:12.939540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:12.940655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:12.941338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:12.941755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:12.942778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:12.943202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:12.943642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:12.945661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:12.955540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 105/214] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:12.961362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:13.024842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f40c2-cf6b-4f84-a561-6c22eb0787cb None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.060591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.061430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.061887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.062329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.062992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510cb4-2d8e-4434-bc2d-fd1a8732c2f8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.063356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:13.065225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:13.088456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 110/215] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:12 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:13.102514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.103276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.103651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.104002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] PATH_INFO: `/v3/users/9b534142e5404288b74eebee8fa55f0c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.120419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] RBAC: Authorizing `identity:get_user(user_id=9b534142e5404288b74eebee8fa55f0c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:13.121921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:13.123912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 106/216] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:12 2022] GET /identity/v3/users/9b534142e5404288b74eebee8fa55f0c => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:13.130005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:13.181041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:13.200956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:13.226091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:13.247455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66954651-d520-4cd6-8b35-5a793d9ae48f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.288077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.288680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.288956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.289227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.289956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] RBAC: Adding query filter params (role.id=c4d52d7819e647bcbe57fa726e019998, user.id=9b534142e5404288b74eebee8fa55f0c, scope.system=all) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:13.290267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:13.291806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:13.293373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0667-e080-473c-bc00-37c802295870 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.298474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 111/217] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 12:57:13 2022] GET /identity/v3/role_assignments?user.id=9b534142e5404288b74eebee8fa55f0c&scope.system=all&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:13.335055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.335773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.336144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.336427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.348117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:13.353313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:13.354229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:13.355057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 107/218] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:13.360919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:13.480686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a928ec-68d1-405a-8542-0d7de0617272 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.516722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.517343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.517623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.517896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.518570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:13.518876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:13.520298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:13.529530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 112/219] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:13.535197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:13.617514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:13.640636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf607a4-f626-40d2-bf88-dfb78f0ca9d4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.676371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.677002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.678060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.678339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] PATH_INFO: `/v3/users/fbd6ca2632d34a409b2069961159457f` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.679498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] RBAC: Authorizing `identity:get_user(user_id=fbd6ca2632d34a409b2069961159457f)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:13.680969 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:13.682861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 108/220] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:13 2022] GET /identity/v3/users/fbd6ca2632d34a409b2069961159457f => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:13.688454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:13.702151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:13.809005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42edbc-266c-4d15-a101-03ce900b23b2 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:13.842893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:13.843546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:13.843830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:13.844108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:13.914785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:13.916617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:13.928662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:14.017461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 113/221] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:14.022834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:14.126189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78c70-2b68-46b6-b128-0e3102211e48 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:14.163246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cedb1-88b0-49c6-adda-7f38e2a5cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:14.163922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cedb1-88b0-49c6-adda-7f38e2a5cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:14.164205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cedb1-88b0-49c6-adda-7f38e2a5cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:14.164480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cedb1-88b0-49c6-adda-7f38e2a5cdb4 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:14.165620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cedb1-88b0-49c6-adda-7f38e2a5cdb4 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:14.167089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cedb1-88b0-49c6-adda-7f38e2a5cdb4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:14.169070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 109/222] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:14 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:14.174885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:14.277701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a159a7-aea0-4b2a-8d7b-1b45d82391b5 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:14.288972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:14.313022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:14.313641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:14.313922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:14.314199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:14.314930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] RBAC: Adding query filter params (role.id=763e5f65333e4cf38530b8c23563ad18, scope.project.id=7eb57d06fbbf4501b56a504649f843b8, user.id=fbd6ca2632d34a409b2069961159457f) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:14.315240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:14.316777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f6645-2193-4314-b192-9c433cb3ba12 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:14.322565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 114/223] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:14 2022] GET /identity/v3/role_assignments?user.id=fbd6ca2632d34a409b2069961159457f&scope.project.id=7eb57d06fbbf4501b56a504649f843b8&role.id=763e5f65333e4cf38530b8c23563ad18 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:15.418725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ea973-0b46-4737-9d9f-436beb2d54e3 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.419281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ea973-0b46-4737-9d9f-436beb2d54e3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.419281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ea973-0b46-4737-9d9f-436beb2d54e3 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.420868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 110/224] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:15.426442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0500c-9fe2-4e43-937b-ebc4b57862a4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.426968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0500c-9fe2-4e43-937b-ebc4b57862a4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.426968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0500c-9fe2-4e43-937b-ebc4b57862a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.446283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-62d0500c-9fe2-4e43-937b-ebc4b57862a4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:15.447499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-62d0500c-9fe2-4e43-937b-ebc4b57862a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:15.503842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab43d4-283b-44d6-8eb6-76fffb4a71a4 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.504142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab43d4-283b-44d6-8eb6-76fffb4a71a4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.504398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab43d4-283b-44d6-8eb6-76fffb4a71a4 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.505785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 111/225] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:15.510658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.510942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.511222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.515946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 115/226] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:15.518085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb699c7d-70e5-413d-9f36-4aacf2ec6919 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.518366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb699c7d-70e5-413d-9f36-4aacf2ec6919 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.518666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb699c7d-70e5-413d-9f36-4aacf2ec6919 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.520058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 116/227] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:15.524736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.525018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.525292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.531740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:15.532923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:15.543028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:15.543460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:15.544330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:15.603204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 112/228] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:15.613932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 117/229] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:15.790178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:15.870140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:15.889860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a185992-4564-4346-9e8b-85abf62c6995 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:15.904325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:15.923543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:15.924170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:15.924453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:15.924720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:15.925807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:15.927550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:15.929114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 113/230] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:15.929114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:15.945232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:15.970715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174bfb-e9f3-4854-a3ba-eea56b78b284 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.005910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.006473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.006745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.007012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.016788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:16.021729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:16.022583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:16.023347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:16.024027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.031102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c422a-dd86-486f-948e-20d38c4d8ba7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.064568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.065192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.065471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.065742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.076108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:16.081009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:16.081890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:16.082676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 114/232] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:16.083329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.118777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:16.126863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ecad0-ead8-43b0-a6c2-cdea161d7ce6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.150454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:16.161665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.162274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.162551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.162822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] PATH_INFO: `/v3/groups` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.163468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.164924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.180728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd24c-1b28-464f-b702-5070c31a857d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.180945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 119/233] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Oct 13 12:57:16 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:16.195068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.221522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.223008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.223312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.223624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.224871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:16.225165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.226602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.238673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 115/234] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:16.245354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.297457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec22540-2a93-47f6-ad29-693793c8e0bb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.334654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.335289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.335598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.335874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.336558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:16.336863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.338343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.347607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 120/235] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:16.353979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.361224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d1e8-f304-42de-8592-4664795aabba None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.375040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:16.400857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.401500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.402241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.402241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] PATH_INFO: `/v3/users/7e824d0b59434be5bb5aa353150bd675` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.404814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:16.420425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e824d0b59434be5bb5aa353150bd675)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.422052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.424259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 116/236] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:16 2022] GET /identity/v3/users/7e824d0b59434be5bb5aa353150bd675 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:16.430899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.476255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb53101-9dfb-402f-a78c-8f1b193b6e86 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.513404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.514033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.514310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.514585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] PATH_INFO: `/v3/users/9b534142e5404288b74eebee8fa55f0c` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.515732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] RBAC: Authorizing `identity:get_user(user_id=9b534142e5404288b74eebee8fa55f0c)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.517185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.518781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 121/237] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:16 2022] GET /identity/v3/users/9b534142e5404288b74eebee8fa55f0c => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:16.524260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:16.533970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfeaf-6713-484a-805f-d227f0e86be7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.569432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.569962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.570248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.570523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.571246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] RBAC: Adding query filter params (role.id=763e5f65333e4cf38530b8c23563ad18, user.id=7e824d0b59434be5bb5aa353150bd675, scope.system=all) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:16.571591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.573043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517b12a-2ae0-4746-ab3b-ca23811dc98c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.578025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 117/238] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 12:57:16 2022] GET /identity/v3/role_assignments?user.id=7e824d0b59434be5bb5aa353150bd675&scope.system=all&role.id=763e5f65333e4cf38530b8c23563ad18 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:16.624556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:16.643416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ac8c-edbf-4969-913e-4c035acdd2ae None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:16.681126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28147afe-57df-4f2d-835f-6b3abdd737bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:16.681805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28147afe-57df-4f2d-835f-6b3abdd737bf None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:16.682577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28147afe-57df-4f2d-835f-6b3abdd737bf None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:16.682577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28147afe-57df-4f2d-835f-6b3abdd737bf None admin] PATH_INFO: `/v3/system/users/9b534142e5404288b74eebee8fa55f0c/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:16.683899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28147afe-57df-4f2d-835f-6b3abdd737bf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b534142e5404288b74eebee8fa55f0c, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:16.685586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28147afe-57df-4f2d-835f-6b3abdd737bf None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:16.695948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 122/239] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Oct 13 12:57:16 2022] PUT /identity/v3/system/users/9b534142e5404288b74eebee8fa55f0c/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 12:57:18.342593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425b7c-2a23-429a-9419-e0304d828989 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.343104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425b7c-2a23-429a-9419-e0304d828989 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.343104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425b7c-2a23-429a-9419-e0304d828989 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.344662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 118/240] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:18.350513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248bcdc-f1ff-460a-b414-a9801aff8ece None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.350932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248bcdc-f1ff-460a-b414-a9801aff8ece None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.351095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248bcdc-f1ff-460a-b414-a9801aff8ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.368707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a248bcdc-f1ff-460a-b414-a9801aff8ece None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:18.369887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a248bcdc-f1ff-460a-b414-a9801aff8ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:18.434568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 123/241] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:18.697419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af425b7c-2a23-429a-9419-e0304d828989 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:18.720151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999db9-6725-4563-8dfc-96f350e7209c None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.720498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999db9-6725-4563-8dfc-96f350e7209c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.720721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999db9-6725-4563-8dfc-96f350e7209c None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.722399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 124/242] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:18.730814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767088-bda1-4589-94b4-daf128c5e0da None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.731103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767088-bda1-4589-94b4-daf128c5e0da None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.731383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767088-bda1-4589-94b4-daf128c5e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.750658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b0767088-bda1-4589-94b4-daf128c5e0da None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:18.752259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b0767088-bda1-4589-94b4-daf128c5e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:18.770512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:18.816647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af425b7c-2a23-429a-9419-e0304d828989 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:18.825507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 125/243] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:18.836881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad147-bafd-4fe4-b004-b6a485fdbc8e None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.837167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad147-bafd-4fe4-b004-b6a485fdbc8e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.837447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad147-bafd-4fe4-b004-b6a485fdbc8e None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.838745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 126/244] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:18.843847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.844205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.844704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.852785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:18.853516 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:18.853801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:18.854072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:18.855152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:18.856628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:18.858355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 119/245] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:18.863501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:18.864190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:18.865821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:18.869007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:18.942500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 127/246] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:18.968633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58780e-57c9-4a2b-b55d-b8381a553e37 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:18.992250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:19.003525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.004132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.004409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.004674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] PATH_INFO: `/v3/groups` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.005875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:19.007299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:19.023091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 120/247] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Oct 13 12:57:18 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 12:57:19.094411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.203202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9a4d3-8fa2-4f54-bf0f-e3d45a342829 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.208891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.240994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.241555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.241835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.242106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.249044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:19.253366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:19.259239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:19.260320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:19.261140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 128/248] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:19.269615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.341410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531e69-ed73-4cb7-ba44-85f0a5e19c64 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.391610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.392254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.392522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.392794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.395348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e87a-fbbe-4345-8839-6ff1bbda62ef None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.407818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:19.415808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:19.416720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:19.417512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 121/249] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:19.423653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.439580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.440873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.441377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.442481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.446066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:19.446066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:19.446066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:19.460996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 129/250] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:19.466508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.486902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:19.553563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:19.569226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112170b-56ca-4e12-9509-d491af5bfe6a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.612386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34ce16-247a-4ced-b855-65cdf9ca64aa None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.616018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.616637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.616922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.617195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.617871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:19.618174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:19.620085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:19.629803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 122/251] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:19.635731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.656209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.656944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.657222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.657492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] PATH_INFO: `/v3/users/7e824d0b59434be5bb5aa353150bd675` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.658734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] RBAC: Authorizing `identity:get_user(user_id=7e824d0b59434be5bb5aa353150bd675)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:19.660475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:19.662468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 130/252] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/users/7e824d0b59434be5bb5aa353150bd675 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:19.670163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.775043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b95c3-b66a-48da-a427-feddd5ee6c25 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.782548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:19.811753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9391b-bd46-4a7a-a955-73edc54ab83a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:19.811994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.812601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.814216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.814216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] PATH_INFO: `/v3/users/9b534142e5404288b74eebee8fa55f0c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.814398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=9b534142e5404288b74eebee8fa55f0c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:19.816220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:19.817911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 123/253] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/users/9b534142e5404288b74eebee8fa55f0c => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:19.825930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:19.848949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:19.860492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f9937-e70c-47cb-b4ee-ba5268180e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:19.860492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f9937-e70c-47cb-b4ee-ba5268180e15 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:19.860737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f9937-e70c-47cb-b4ee-ba5268180e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:19.860805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f9937-e70c-47cb-b4ee-ba5268180e15 None admin] PATH_INFO: `/v3/system/users/7e824d0b59434be5bb5aa353150bd675/roles/763e5f65333e4cf38530b8c23563ad18` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:19.862337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f9937-e70c-47cb-b4ee-ba5268180e15 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e824d0b59434be5bb5aa353150bd675, role_id=763e5f65333e4cf38530b8c23563ad18)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:19.864355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f9937-e70c-47cb-b4ee-ba5268180e15 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:19.875882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 131/254] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Oct 13 12:57:19 2022] PUT /identity/v3/system/users/7e824d0b59434be5bb5aa353150bd675/roles/763e5f65333e4cf38530b8c23563ad18 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 12:57:19.962119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ddb0-a5c3-4ed0-8992-ba3217303ff4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:20.001144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:20.002157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:20.002645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:20.003133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:20.004166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] RBAC: Adding query filter params (role.id=c4d52d7819e647bcbe57fa726e019998, user.id=9b534142e5404288b74eebee8fa55f0c, scope.system=all) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:20.004689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:20.006490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca587c-76ac-46cd-b4cc-1b09c9b763bf None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:20.022975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 124/255] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 12:57:19 2022] GET /identity/v3/role_assignments?user.id=9b534142e5404288b74eebee8fa55f0c&scope.system=all&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:21.714377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6a75-2d18-4253-a967-9a0ef39f6f01 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:21.715392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6a75-2d18-4253-a967-9a0ef39f6f01 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:21.715928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6a75-2d18-4253-a967-9a0ef39f6f01 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:21.717520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 132/256] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:21.723033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:21.723475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:21.723676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:21.734405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeae0d-4c82-4402-b4d0-8e618bedb59f None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:21.734685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeae0d-4c82-4402-b4d0-8e618bedb59f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:21.734955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeae0d-4c82-4402-b4d0-8e618bedb59f None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:21.736619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 133/257] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:21.741653 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:21.741938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:21.742209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:21.776461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:21.777685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:21.779590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:21.780779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:21.861140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:21.889639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 134/258] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 12:57:21.939702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 125/259] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 12:57:22.480538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.491471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d48fa-b6df-42b9-aef8-c202b4230047 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.499802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.500444 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.500717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.500983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.518649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:22.527012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:22.527928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:22.528703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 135/260] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:22.531666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.533860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.550211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d779-36b6-4980-a614-dd91553af326 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.555270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5292cd5-f27f-4db1-a128-5f182d242909 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.561500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.562090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.562366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.562635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.562802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.563315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:22.563511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.563673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.563818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.563961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.565507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 12:57:22.565507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 12:57:22.565507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 12:57:22.566425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.585181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 136/261] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:22.586863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:22.596041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:22.598224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:22.600783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:22.602271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.602416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 126/262] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:22.609681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af480-9a84-4a54-a78a-5191485d8726 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.612458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.617139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.617796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.618083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.618363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.625803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394de30d-b949-489e-b7c4-83c7c297b10c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.633277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.634358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 12:57:22.634358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 12:57:22.634358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 12:57:22.635651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.639060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 137/263] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:22.645557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.648741 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.649374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.649650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.649919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.650597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:22.650899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.652743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 12:57:22.652743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 12:57:22.652743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 12:57:22.653669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.660768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33fb4-6291-47fe-9f3e-554fd7595dfb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.667087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 127/264] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:22.668421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.669086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.669368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.669696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.671785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.674154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.675360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.679437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 138/265] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:22.686647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.689683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d851ac-2e5c-4d65-a5e0-c502aeac9322 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.700156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1632f-5c73-4300-9557-5a1b2ea537f5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.704032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.704682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.704963 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.705240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.706381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.707481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 12:57:22.707481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 12:57:22.707481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 12:57:22.709207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.709517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.710682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.710856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 128/266] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:22.718088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.718088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e/groups/f52b031b214e4c948980437ea8c4de84/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.718088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01339a8c203487885efc6b1d726951e, group_id=f52b031b214e4c948980437ea8c4de84, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.718944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 12:57:22.718944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 12:57:22.718944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 12:57:22.728079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.729177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.742506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01c1d2-961a-44e6-9e80-efca885aa05a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.750482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 139/267] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 12:57:22 2022] PUT /identity/v3/projects/d01339a8c203487885efc6b1d726951e/groups/f52b031b214e4c948980437ea8c4de84/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:22.836256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d506766-efb6-4d59-bf24-602e83e3fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.836908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506766-efb6-4d59-bf24-602e83e3fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.837189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506766-efb6-4d59-bf24-602e83e3fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.837460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d506766-efb6-4d59-bf24-602e83e3fa90 admin admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.844345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d506766-efb6-4d59-bf24-602e83e3fa90 admin admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.846539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d506766-efb6-4d59-bf24-602e83e3fa90 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.848787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 129/268] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 12:57:22 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:22.854226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:22.871335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea150-6e77-43b1-af92-ff44f2cc2b43 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:22.879781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100d69-e0b8-4a74-bd16-894ae144601d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.880658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100d69-e0b8-4a74-bd16-894ae144601d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.880879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100d69-e0b8-4a74-bd16-894ae144601d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.881791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013ad6b-f4f2-41dc-b467-74bc9ecb0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:22.882278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 130/269] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:22.882907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013ad6b-f4f2-41dc-b467-74bc9ecb0f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.883395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013ad6b-f4f2-41dc-b467-74bc9ecb0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.883925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013ad6b-f4f2-41dc-b467-74bc9ecb0f9c admin admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e/groups/f52b031b214e4c948980437ea8c4de84/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.888094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec05f7-55c3-48b8-8352-281cf6679b56 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:22.888379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec05f7-55c3-48b8-8352-281cf6679b56 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:22.888658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec05f7-55c3-48b8-8352-281cf6679b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:22.889502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013ad6b-f4f2-41dc-b467-74bc9ecb0f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01339a8c203487885efc6b1d726951e, group_id=f52b031b214e4c948980437ea8c4de84, role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:22.892661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013ad6b-f4f2-41dc-b467-74bc9ecb0f9c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:22.917703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 140/270] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 12:57:22 2022] PUT /identity/v3/projects/d01339a8c203487885efc6b1d726951e/groups/f52b031b214e4c948980437ea8c4de84/roles/5777ac04a7a942daa22c6642ded5268a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:22.922672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-73ec05f7-55c3-48b8-8352-281cf6679b56 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:22.924295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-73ec05f7-55c3-48b8-8352-281cf6679b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:23.015699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 131/271] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:23.133953 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e76b7-bea3-4e42-b150-bef2e254e01a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.134707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e76b7-bea3-4e42-b150-bef2e254e01a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.135184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e76b7-bea3-4e42-b150-bef2e254e01a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.137191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 141/272] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:23.143198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.143811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.144290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.165312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:23.166916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:23.200882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:23.234655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 132/273] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 12:57:23.384874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e76b7-bea3-4e42-b150-bef2e254e01a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.490899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:23.514280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e76b7-bea3-4e42-b150-bef2e254e01a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.556489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.557325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.557703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.558070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.569043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:23.574168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:23.575115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:23.575925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 142/274] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:23.582180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.696209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c171445-d645-4a8b-a59b-a6829069636e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.718374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.737654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2e65-6780-41ca-a639-9a90157af97b None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.751349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.752101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.752378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.752689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.772990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:23.775979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.776664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.776942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.777254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.777936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:23.778237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:23.779902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:23.780637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:23.781489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:23.782280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:23.790091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 133/275] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:23.791934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 143/276] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:23.795975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.798048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.813812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca399c-3b4c-423c-a4a3-18a9743dcf0d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.823018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.823794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.824196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.824572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.825465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] RBAC: Adding query filter params (name=member) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:23.825920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:23.827699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:23.842884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:23.847447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 144/277] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:23.853397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.864244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a05b-6bdd-42e8-917d-186a935695ac admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.878351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.879013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.879293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.879596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.880801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:23.882728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:23.891800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 145/278] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:23.892672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.909325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f70f-35e5-4d9a-bdb3-34db7b5ca4cb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.916842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d228fc-afaf-4530-9b6c-edeb70cb9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.917724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d228fc-afaf-4530-9b6c-edeb70cb9a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.918001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d228fc-afaf-4530-9b6c-edeb70cb9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.918270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d228fc-afaf-4530-9b6c-edeb70cb9a80 admin admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.920243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d228fc-afaf-4530-9b6c-edeb70cb9a80 admin admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:23.922282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d228fc-afaf-4530-9b6c-edeb70cb9a80 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:23.924090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 146/279] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:23.925031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58f309-3305-4b06-9314-b6ad66233f6c None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.925310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58f309-3305-4b06-9314-b6ad66233f6c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.925577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58f309-3305-4b06-9314-b6ad66233f6c None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.926748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 147/280] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:23.936323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58f309-3305-4b06-9314-b6ad66233f6c None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:23.947891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360e114-3905-43fe-ad54-763e658abe0f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.972732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58f309-3305-4b06-9314-b6ad66233f6c None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:23.983039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.984129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.984648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.985136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8/groups/f52b031b214e4c948980437ea8c4de84/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:23.987449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb57d06fbbf4501b56a504649f843b8, group_id=f52b031b214e4c948980437ea8c4de84, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:23.991028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:23.996281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5882e7-56e5-4da1-b6a1-bfb46d927398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:23.996846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5882e7-56e5-4da1-b6a1-bfb46d927398 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:23.997132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5882e7-56e5-4da1-b6a1-bfb46d927398 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:23.997489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5882e7-56e5-4da1-b6a1-bfb46d927398 None admin] PATH_INFO: `/v3/users/7e824d0b59434be5bb5aa353150bd675` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.000138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5882e7-56e5-4da1-b6a1-bfb46d927398 None admin] RBAC: Authorizing `identity:get_user(user_id=7e824d0b59434be5bb5aa353150bd675)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:24.001304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5882e7-56e5-4da1-b6a1-bfb46d927398 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:24.003618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 134/281] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:57:23 2022] GET /identity/v3/users/7e824d0b59434be5bb5aa353150bd675 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:24.006682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.006682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.006682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.015578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 148/282] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 12:57:23 2022] PUT /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8/groups/f52b031b214e4c948980437ea8c4de84/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:24.018776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:24.048516 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:24.049810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:24.138079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 135/283] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 12:57:24.144113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:24.151079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfa558-599b-424a-8bbe-119c4e60e576 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:24.196314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:24.197338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.197855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.198378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.199320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] RBAC: Adding query filter params (role.id=763e5f65333e4cf38530b8c23563ad18, user.id=7e824d0b59434be5bb5aa353150bd675, scope.system=all) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:24.199925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:24.201662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:24.216068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 149/284] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 12:57:24 2022] GET /identity/v3/role_assignments?user.id=7e824d0b59434be5bb5aa353150bd675&scope.system=all&role.id=763e5f65333e4cf38530b8c23563ad18 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:24.578245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:24.588692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7f399-9b5f-48c0-b48a-f57be742c518 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:24.598707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:24.599758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.600266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.600734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.618189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:24.623728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:24.624575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:24.625332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:24.627863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 136/285] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 12:57:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:24.635373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:24.646641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6725a-9523-415e-9d96-a009872b906c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:24.655586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:24.656524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.657060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.657527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.658386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:24.658937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:24.660969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:24.670222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 150/286] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 12:57:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:24.675819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:24.690833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347966fe-8bf9-449b-abe4-5c5f5948bb82 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:24.698423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:24.699370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.699902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.700404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.701779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:24.704006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:24.706234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 137/287] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 12:57:24 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:24.716460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:24.735798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a374d8-802d-4392-bb8a-71bc1c88d6da admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:24.748390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93920ef-68a0-4b8e-965f-c77406bdb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:24.749460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93920ef-68a0-4b8e-965f-c77406bdb8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.750056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93920ef-68a0-4b8e-965f-c77406bdb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.750573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93920ef-68a0-4b8e-965f-c77406bdb8fb admin admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.752128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93920ef-68a0-4b8e-965f-c77406bdb8fb admin admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:24.754774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93920ef-68a0-4b8e-965f-c77406bdb8fb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:24.757446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 151/288] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 12:57:24 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:24.763264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:24.774049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2eb65-c2c4-4519-8fbe-f648d25a018d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:24.780421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:24.781784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.782421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.782902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8/groups/f52b031b214e4c948980437ea8c4de84/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.785431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb57d06fbbf4501b56a504649f843b8, group_id=f52b031b214e4c948980437ea8c4de84, role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:24.786754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 12:57:24.786754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 12:57:24.786754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 12:57:24.789232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f402a77-8a70-45d8-9958-4870fbc5f39e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:24.811115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 138/289] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 12:57:24 2022] PUT /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8/groups/f52b031b214e4c948980437ea8c4de84/roles/5777ac04a7a942daa22c6642ded5268a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:24.858473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea474c4-e2cb-41c5-a1d5-bb7e777fd20b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.858764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea474c4-e2cb-41c5-a1d5-bb7e777fd20b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.858955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea474c4-e2cb-41c5-a1d5-bb7e777fd20b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.860576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 152/290] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:24.866925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:24.867591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:24.868067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:24.895632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:24.897341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:24.928605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:24.979078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 139/291] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 12:57:25.359483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea474c4-e2cb-41c5-a1d5-bb7e777fd20b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:25.374654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea474c4-e2cb-41c5-a1d5-bb7e777fd20b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:25.379422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:25.380150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.380429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.380699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.396932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:25.402030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:25.402879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:25.403687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 153/292] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 12:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:25.410818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:25.427906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1166b-3659-431d-9bf3-b65302447ca7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:25.435615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:25.436235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.436514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.436789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.437467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:25.437770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:25.439393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:25.451177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 140/293] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:25.457076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:25.470170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b6477-97fa-4672-90b6-4f785f9ca2fe admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:25.476063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:25.476762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.477094 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.477364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] PATH_INFO: `/v3/groups/515b2a1890ec454798795cd2221d5c76` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.484264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] RBAC: Authorizing `identity:get_group(group_id=515b2a1890ec454798795cd2221d5c76)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:25.486188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:25.488222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 154/294] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 12:57:25 2022] GET /identity/v3/groups/515b2a1890ec454798795cd2221d5c76 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:25.494128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:25.509220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54012-b37a-453f-b6d7-a0dd722db887 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:25.519451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4c8a-41b6-4c46-8df5-de4e90809c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:25.520079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4c8a-41b6-4c46-8df5-de4e90809c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.520358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4c8a-41b6-4c46-8df5-de4e90809c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.520662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4c8a-41b6-4c46-8df5-de4e90809c6f admin admin] PATH_INFO: `/v3/projects/da5ea501d94c4d04b906442faafb4921` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.524073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4c8a-41b6-4c46-8df5-de4e90809c6f admin admin] RBAC: Authorizing `identity:get_project(project_id=da5ea501d94c4d04b906442faafb4921)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:25.525883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4c8a-41b6-4c46-8df5-de4e90809c6f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:25.527865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 141/295] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 12:57:25 2022] GET /identity/v3/projects/da5ea501d94c4d04b906442faafb4921 => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:25.533356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:25.544996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb63b7-22a6-4e1c-85d8-a48d860f02d0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:25.551244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74deed1-7c56-4029-ad21-12e006e3c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:25.552815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74deed1-7c56-4029-ad21-12e006e3c9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.553096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74deed1-7c56-4029-ad21-12e006e3c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.553372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74deed1-7c56-4029-ad21-12e006e3c9a1 admin admin] PATH_INFO: `/v3/projects/da5ea501d94c4d04b906442faafb4921/groups/515b2a1890ec454798795cd2221d5c76/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.555456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74deed1-7c56-4029-ad21-12e006e3c9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5ea501d94c4d04b906442faafb4921, group_id=515b2a1890ec454798795cd2221d5c76, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:25.558278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74deed1-7c56-4029-ad21-12e006e3c9a1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:25.581386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 155/296] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 12:57:25 2022] PUT /identity/v3/projects/da5ea501d94c4d04b906442faafb4921/groups/515b2a1890ec454798795cd2221d5c76/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:25.843058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85447-08fe-4dd4-80d2-e8ec3015723e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.843764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85447-08fe-4dd4-80d2-e8ec3015723e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.843764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85447-08fe-4dd4-80d2-e8ec3015723e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.845094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 142/297] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:25.850996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed1af-d809-4ccd-b5e2-3ddfdefb39f3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:25.851496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed1af-d809-4ccd-b5e2-3ddfdefb39f3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:25.851651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed1af-d809-4ccd-b5e2-3ddfdefb39f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:25.871875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f62ed1af-d809-4ccd-b5e2-3ddfdefb39f3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:25.873071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f62ed1af-d809-4ccd-b5e2-3ddfdefb39f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:25.959089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 156/298] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:26.025013 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ea08-6bf1-413e-a357-ee929386a61a None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:26.025307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ea08-6bf1-413e-a357-ee929386a61a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:26.025484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ea08-6bf1-413e-a357-ee929386a61a None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:26.027109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 143/299] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:26.032339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:26.032626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:26.032905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:26.064436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:26.065645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:26.110286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:26.149716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 157/300] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:26.361363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ea08-6bf1-413e-a357-ee929386a61a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:26.476568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ea08-6bf1-413e-a357-ee929386a61a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:26.520112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:26.521324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:26.521603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:26.521875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:26.539429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:26.540274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:26.541083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:26.543269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 144/301] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:26.551211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:26.577899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:26.604038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:26.750910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ceecf-d440-40fa-bc5f-9a4ff36ebb11 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:26.768602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0209f46-bde0-4d49-b41e-849a91911169 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:26.802811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:26.805305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:26.805664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:26.805956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:26.820142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:26.826367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:26.827248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:26.828068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:26.828649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 145/302] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:26.834735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:26.881220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:26.881871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:26.882121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:26.882394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:26.883068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:26.883368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:26.884787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:26.907454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 158/303] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:26.914989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:26.932517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:26.958508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce66ad-2341-4ae2-b7d3-fa5d278a5a35 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:26.998894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:26.999441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:26.999729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.000005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.000721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:27.001021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.002458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.013468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 146/304] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:27.019763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.022086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:27.129312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d7f84-d7ab-4eaa-b0d4-bdbc56bbf818 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:27.162857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51fb6d-3da1-4a07-8c80-f15b55f6aa7f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:27.184764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d623-046c-42cb-9b1b-1e5a8a58cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:27.185749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d623-046c-42cb-9b1b-1e5a8a58cadc None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.186259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d623-046c-42cb-9b1b-1e5a8a58cadc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.187307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d623-046c-42cb-9b1b-1e5a8a58cadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.207599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee044510-0b39-4cae-a9d5-dc2f3009f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:27.208714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044510-0b39-4cae-a9d5-dc2f3009f238 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.208993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044510-0b39-4cae-a9d5-dc2f3009f238 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.209265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044510-0b39-4cae-a9d5-dc2f3009f238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.219014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.287062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d623-046c-42cb-9b1b-1e5a8a58cadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.289013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d623-046c-42cb-9b1b-1e5a8a58cadc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.295680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044510-0b39-4cae-a9d5-dc2f3009f238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.297379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044510-0b39-4cae-a9d5-dc2f3009f238 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.326081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.412321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 159/305] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 12:57:27.413939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5ece-d3b2-4055-98b8-f84ebeb21c8e None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.414396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5ece-d3b2-4055-98b8-f84ebeb21c8e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.414823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e5ece-d3b2-4055-98b8-f84ebeb21c8e None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.416528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 160/306] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:27.422219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5ece-d3b2-4055-98b8-f84ebeb21c8e None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:27.436138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 147/307] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:27.438018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.438442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.438840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.462742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:27.464864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:27.504107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.561898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e5ece-d3b2-4055-98b8-f84ebeb21c8e None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:27.562422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 148/308] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:27.563294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:27.604675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.611912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:27.612561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.612833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.613109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.614853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.616410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.618486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 161/309] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:27.626448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:27.675044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf557-4558-4029-905f-ee65b91f1623 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:27.716634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9128267-c806-45d5-a6ca-6683e32eb22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:27.717501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9128267-c806-45d5-a6ca-6683e32eb22d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.717785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9128267-c806-45d5-a6ca-6683e32eb22d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.718116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9128267-c806-45d5-a6ca-6683e32eb22d None admin] PATH_INFO: `/v3/projects/d01339a8c203487885efc6b1d726951e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.719335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9128267-c806-45d5-a6ca-6683e32eb22d None admin] RBAC: Authorizing `identity:get_project(project_id=d01339a8c203487885efc6b1d726951e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.720806 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9128267-c806-45d5-a6ca-6683e32eb22d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.727832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 149/310] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/projects/d01339a8c203487885efc6b1d726951e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:27.729307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6d1c2-3f9b-44db-82a7-c23df57c55c7 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.734044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6d1c2-3f9b-44db-82a7-c23df57c55c7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.734628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6d1c2-3f9b-44db-82a7-c23df57c55c7 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.736202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 150/311] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:27.737119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6d1c2-3f9b-44db-82a7-c23df57c55c7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:27.741597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5830110-a888-41a2-96cd-ed556902e4a5 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:27.777151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.781191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92b33-0dcb-4fd9-bed7-00420fa448b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:27.782089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92b33-0dcb-4fd9-bed7-00420fa448b7 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.782568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92b33-0dcb-4fd9-bed7-00420fa448b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.783038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92b33-0dcb-4fd9-bed7-00420fa448b7 None admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.784404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92b33-0dcb-4fd9-bed7-00420fa448b7 None admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.786116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92b33-0dcb-4fd9-bed7-00420fa448b7 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.791622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 162/312] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:27.793040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.793539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.794107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.816680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:27.818201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:27.852414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6d1c2-3f9b-44db-82a7-c23df57c55c7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:27.887761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:27.890228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:27.890873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:27.891134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:27.891500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:27.892755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:27.893552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 163/313] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:27.894326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:27.899322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 151/314] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:27.899474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:27.906845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.015650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa72d7-d764-4226-992e-5f5d2b8af9b6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.016537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e95d-d823-4d84-b05e-a0543a979406 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.019748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:28.052370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.052991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.053270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.053544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.054279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] RBAC: Adding query filter params (group.id=f52b031b214e4c948980437ea8c4de84, role.id=5777ac04a7a942daa22c6642ded5268a, scope.project.id=d01339a8c203487885efc6b1d726951e) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:28.054708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:28.058061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:28.064112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.064667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 164/315] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/role_assignments?group.id=f52b031b214e4c948980437ea8c4de84&scope.project.id=d01339a8c203487885efc6b1d726951e&role.id=5777ac04a7a942daa22c6642ded5268a => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:28.064775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.064979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.065246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.065481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.066078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] RBAC: Adding query filter params (group.id=f52b031b214e4c948980437ea8c4de84, role.id=c4d52d7819e647bcbe57fa726e019998, scope.project.id=d01339a8c203487885efc6b1d726951e) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:28.066451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:28.068651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:28.075454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 152/316] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 12:57:27 2022] GET /identity/v3/role_assignments?group.id=f52b031b214e4c948980437ea8c4de84&scope.project.id=d01339a8c203487885efc6b1d726951e&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:28.139969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:28.193298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef1e91-338f-4850-83e3-2e0bb5e485a8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.238905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.240201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.240476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.240741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.256547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:28.262247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:28.263200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:28.264028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 165/317] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:28.270850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.385610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c0a0-dc70-4b25-a907-b4cc228efa64 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.395164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.434779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.435493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.435784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.436062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.436740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] RBAC: Adding query filter params (name=member) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:28.437045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:28.438698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:28.450189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 153/318] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:28.458823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.504051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:28.542231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbbc48-492c-40a9-a0a9-6aa8e24666d0 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.573004 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:28.586163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95bba5-ec10-4ab2-a937-d8ff8fbb624e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.588612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.589628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.590112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.590589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.607060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:28.612023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:28.612902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:28.613683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 166/319] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:28.622771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.640750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303d575-7a6e-4f01-b026-e0de98c6d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.641282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d575-7a6e-4f01-b026-e0de98c6d576 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.641811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d575-7a6e-4f01-b026-e0de98c6d576 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.642083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d575-7a6e-4f01-b026-e0de98c6d576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.743330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303d575-7a6e-4f01-b026-e0de98c6d576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:28.745152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303d575-7a6e-4f01-b026-e0de98c6d576 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:28.764319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea243e-f1ef-4913-9d55-fcd3739ff0ab None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.788826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:28.805410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.806039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.806368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.806631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.807318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:28.807662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:28.809032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a08e3-e80a-4d78-9714-846ec92d5562 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:28.818440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 167/320] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:28.818440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7740-6e32-450c-9ed6-82ef01e2432d None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.818699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7740-6e32-450c-9ed6-82ef01e2432d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.818974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7740-6e32-450c-9ed6-82ef01e2432d None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.820431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 168/321] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:28.825618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7740-6e32-450c-9ed6-82ef01e2432d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.873454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 154/322] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 12:57:28.874838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.875123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.875397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:28.884020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:28.895978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:28.897089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:28.948723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7740-6e32-450c-9ed6-82ef01e2432d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:28.974479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 155/323] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:28.975355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:28.996015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:28.996637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:28.996911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:28.997346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.059897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.071632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.073146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.109730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276910f4-0258-46d0-a146-54c7b26f9a3c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.129398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.157155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.157712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.157990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.158261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.159371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.161656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.163294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 156/324] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:29.169482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.199005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 169/325] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:29.204606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.297691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6a32-bb69-45f4-acdb-4168dbe76fc9 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.320518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066b84-35a5-4870-af5d-1aad390e531c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.331620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.343814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.344450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.344837 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.345855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.346228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.347705 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.351887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 157/326] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:29.356776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.359068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.361225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.361225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.361225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] PATH_INFO: `/v3/projects/7eb57d06fbbf4501b56a504649f843b8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.361663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] RBAC: Authorizing `identity:get_project(project_id=7eb57d06fbbf4501b56a504649f843b8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.363126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.365023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 170/327] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/projects/7eb57d06fbbf4501b56a504649f843b8 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:29.365658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.382576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.478406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacb8e3-6fa8-4b51-a2b5-dc12e88e43f9 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.484447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14504469-9541-4215-a00f-ea38b0f8733e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.520140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.521333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.521609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.521877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.525467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.526321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.526321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.526608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.527393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] RBAC: Adding query filter params (group.id=f52b031b214e4c948980437ea8c4de84, role.id=c4d52d7819e647bcbe57fa726e019998, scope.project.id=7eb57d06fbbf4501b56a504649f843b8) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:29.528541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.529154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.533885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:29.537787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 171/328] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/role_assignments?group.id=f52b031b214e4c948980437ea8c4de84&scope.project.id=7eb57d06fbbf4501b56a504649f843b8&role.id=c4d52d7819e647bcbe57fa726e019998 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:29.538536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:29.538922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:29.539801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:29.540629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:29.541221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 158/329] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:29.547363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.624267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.649240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.678058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5772-f19e-42a4-bc25-c4f9bb4148a4 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.689100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f81f-8c5b-4685-b847-27663e287375 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.720205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.720847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.721135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.721407 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] PATH_INFO: `/v3/groups/f52b031b214e4c948980437ea8c4de84` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.723221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] RBAC: Authorizing `identity:get_group(group_id=f52b031b214e4c948980437ea8c4de84)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.724771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.726405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 172/330] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/groups/f52b031b214e4c948980437ea8c4de84 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:29.732439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.735496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.736113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.736388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.736653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.737316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:29.737618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.738985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.748375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 159/331] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:29.754367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:29.846454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b7073-50fc-40d2-9d93-e2077d0ac559 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.882319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013be37-1f92-444c-8ef5-f9f1963392a1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:29.884604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.885210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.885487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.887488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.887488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] RBAC: Adding query filter params (group.id=f52b031b214e4c948980437ea8c4de84, role.id=5777ac04a7a942daa22c6642ded5268a, scope.project.id=7eb57d06fbbf4501b56a504649f843b8) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:29.887488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:29.888265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:29.894302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 173/332] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/role_assignments?group.id=f52b031b214e4c948980437ea8c4de84&scope.project.id=7eb57d06fbbf4501b56a504649f843b8&role.id=5777ac04a7a942daa22c6642ded5268a => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:29.902364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:29.925068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:29.925703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:29.925984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:29.927440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:29.999019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:30.000448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:30.099982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 160/333] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:30.105649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:30.120800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:30.209287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9cd5b-2d43-4740-ada0-815c591eb85d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:30.242440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:30.243061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:30.243338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:30.243652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] PATH_INFO: `/v3/projects/da5ea501d94c4d04b906442faafb4921` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:30.244755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] RBAC: Authorizing `identity:get_project(project_id=da5ea501d94c4d04b906442faafb4921)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:30.246169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:30.247843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 174/334] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:57:30 2022] GET /identity/v3/projects/da5ea501d94c4d04b906442faafb4921 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:30.253532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:30.271394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:30.347308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12da7-4cbe-45bc-85d4-05b1b21d595c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:30.379648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea88d-2db8-49c8-a913-a8118c601cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:30.380280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea88d-2db8-49c8-a913-a8118c601cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:30.380557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea88d-2db8-49c8-a913-a8118c601cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:30.380823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea88d-2db8-49c8-a913-a8118c601cc3 None admin] PATH_INFO: `/v3/groups/515b2a1890ec454798795cd2221d5c76` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:30.381900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea88d-2db8-49c8-a913-a8118c601cc3 None admin] RBAC: Authorizing `identity:get_group(group_id=515b2a1890ec454798795cd2221d5c76)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:30.383312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea88d-2db8-49c8-a913-a8118c601cc3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:30.384880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 161/335] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 12:57:30 2022] GET /identity/v3/groups/515b2a1890ec454798795cd2221d5c76 => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:30.390677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:30.464841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:30.487353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f466e-01c8-49b0-8f3f-7a7631fb2c13 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:30.518872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:30.519432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:30.519724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:30.519997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:30.521247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] RBAC: Adding query filter params (group.id=515b2a1890ec454798795cd2221d5c76, role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=da5ea501d94c4d04b906442faafb4921) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:30.521557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:30.522971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c63a2-13e6-497e-b52d-419afa30f1ee None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:30.528519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 175/336] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 12:57:30 2022] GET /identity/v3/role_assignments?group.id=515b2a1890ec454798795cd2221d5c76&scope.project.id=da5ea501d94c4d04b906442faafb4921&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:33.268019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae529-666a-47bb-82a6-c0efccc6e99d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:33.268531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae529-666a-47bb-82a6-c0efccc6e99d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:33.268801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae529-666a-47bb-82a6-c0efccc6e99d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:33.270314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 162/337] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:33.275727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6e57-5427-492d-8add-d6e4e17971cd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:33.276167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6e57-5427-492d-8add-d6e4e17971cd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:33.276337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6e57-5427-492d-8add-d6e4e17971cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:33.299515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-984d6e57-5427-492d-8add-d6e4e17971cd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:33.300736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-984d6e57-5427-492d-8add-d6e4e17971cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:33.325501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33fd15-a24a-40ad-8cd0-5647610bcfa2 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:33.325797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33fd15-a24a-40ad-8cd0-5647610bcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:33.326046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33fd15-a24a-40ad-8cd0-5647610bcfa2 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:33.327830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 163/338] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:33.334117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ef83-cc76-4281-9ab2-a79960efe1bd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:33.334701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ef83-cc76-4281-9ab2-a79960efe1bd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:33.335206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ef83-cc76-4281-9ab2-a79960efe1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:33.354860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5443ef83-cc76-4281-9ab2-a79960efe1bd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:33.356496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5443ef83-cc76-4281-9ab2-a79960efe1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:33.429120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 176/339] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:33.439510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 164/340] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:33.501476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea71c0-a815-41ef-bc69-7b8e63e11f5c None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:33.502109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea71c0-a815-41ef-bc69-7b8e63e11f5c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:33.502608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea71c0-a815-41ef-bc69-7b8e63e11f5c None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:33.504199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 177/341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:33.510251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:33.510811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:33.511299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:33.540426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:33.541953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:33.554032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:33.626619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 165/342] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:33.764855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea71c0-a815-41ef-bc69-7b8e63e11f5c None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:33.791386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:33.898003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:33.947610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea71c0-a815-41ef-bc69-7b8e63e11f5c None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:33.988862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4d3b-faa9-4658-b194-3dc4c987376b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.003153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.003950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.004283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.004564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.016992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.018520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.026903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.027624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.027904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.028174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:34.034035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:34.034962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:34.036380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:34.036380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.036380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:34.036380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 178/343] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:34.036684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.041561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.042954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.050489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-62b335ef-934e-4bf9-802f-4c26f1c12c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:34.061200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:34.062152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:34.063008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:34.063008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.063008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:34.063008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 166/344] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:34.063827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b40f-f606-4aa7-b814-d6a63b488dd3 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.064108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b40f-f606-4aa7-b814-d6a63b488dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.064379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b40f-f606-4aa7-b814-d6a63b488dd3 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.065748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 167/345] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:34.066311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801b40f-f606-4aa7-b814-d6a63b488dd3 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.146669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578326-7fa4-4313-8b54-9c8bb6b6c52d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.170213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.170854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801b40f-f606-4aa7-b814-d6a63b488dd3 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.183802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.184434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.184721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.184992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.195626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.197069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.205485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.206100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.206374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.206647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.207283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:34.207614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.209519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-ba9a7833-ad17-46e0-a8b6-33d60ebf424e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:34.211789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:34.212645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:34.213466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:34.213466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.213466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:34.213466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 179/346] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:34.214019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.214277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.214551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.224612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 168/347] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:34.225727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.238556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:34.239818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:34.284081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.311499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 180/348] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:34.318052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.330450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76876-baca-40c5-aa16-c7e3cc51edd8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.367092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.367874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.368255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.368648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.369395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:34.369804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.371393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.383316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 169/349] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:34.384371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.456489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4572-f90b-4ccf-a5be-f6cc96ec7395 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.460937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.495356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.495881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.496256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.496630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.497379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:34.497788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.499256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.510591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1ed11-089d-446c-9468-c099e80679c4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.511270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 181/350] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:34.512170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.533552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.557412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.558647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.558935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.559307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.559896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.561353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.584083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 170/351] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:34 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:34.592522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.625061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b2667-4d01-464e-bc2d-d779c117b1c1 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.665040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c708-62b3-4030-bd1b-b3b64e429ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.665667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c708-62b3-4030-bd1b-b3b64e429ffa None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.665941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c708-62b3-4030-bd1b-b3b64e429ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.666208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c708-62b3-4030-bd1b-b3b64e429ffa None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.666857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6c708-62b3-4030-bd1b-b3b64e429ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.668346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6c708-62b3-4030-bd1b-b3b64e429ffa None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.693172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 182/352] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:34 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:34.694328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d626-d632-4fb4-a242-bcc07efc6248 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.694611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d626-d632-4fb4-a242-bcc07efc6248 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.694882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d626-d632-4fb4-a242-bcc07efc6248 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.696391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 183/353] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:34.701511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d626-d632-4fb4-a242-bcc07efc6248 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:34.731979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.735216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2dc1-33b7-4e88-b3b2-7597c12be8bf None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.793908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a06d1-1270-4327-840e-2f47b7e255a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.794728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a06d1-1270-4327-840e-2f47b7e255a5 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.795502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a06d1-1270-4327-840e-2f47b7e255a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.795502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a06d1-1270-4327-840e-2f47b7e255a5 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.796286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a06d1-1270-4327-840e-2f47b7e255a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.797911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a06d1-1270-4327-840e-2f47b7e255a5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.823367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 171/354] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:34 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:34.824983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.825378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.825743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.851527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:34.852945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:34.854366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d626-d632-4fb4-a242-bcc07efc6248 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:34.892860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:34.912786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:34.913979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:34.914403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:34.914819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:34.930646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:34.933288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:34.956159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 172/355] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:34.956577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:34.957450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:34.958846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:34.958846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:34.958846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:34.960640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 184/356] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:34.966656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:35.076758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08196f5-ac9e-4f5f-a1b8-e419d1948d62 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:35.112686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:35.113627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:35.114665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:35.115112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:35.115968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:35.116444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:35.118020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:35.130985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 173/357] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:35.136164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:35.241048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:35.243731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:35.287828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:35.304076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701631-f436-4cd0-a9d7-104b23d14d2b None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:35.338358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:35.338969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:35.339228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:35.339529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:35.340174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:35.341596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:35.376705 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e8c63-45ea-4868-9abf-f9d257706d81 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:35.381027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 185/358] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:35 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 12:57:35.416254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:35.416969 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:35.417259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:35.417530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:35.418556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:35.420373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:35.429368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.sql.core [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 12:57:35.429368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 12:57:35.429368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [parameters: {'id': '9e97f61d771e4167968cfd3e07f1653e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 12:57:35.429368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81580) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result.read() Oct 13 12:57:35.446599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return ref.to_dict() Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:57:35.448736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application yield resource Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise self.value Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application session.commit() Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 12:57:35.450957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.session.flush() Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application compat.raise_( Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 12:57:35.453073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:57:35.454344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result.read() Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:57:35.459546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [parameters: {'id': '9e97f61d771e4167968cfd3e07f1653e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:35.460403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 12:57:35.461269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:35.462057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 174/359] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 12:57:35 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:35.462119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:35.592251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4887f98-fcb1-415f-a9aa-20c9725f807e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:35.621587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:35.631699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17decf13-00a3-41b0-a5a6-6cd3aa7540cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:35.632494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17decf13-00a3-41b0-a5a6-6cd3aa7540cb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:35.633156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17decf13-00a3-41b0-a5a6-6cd3aa7540cb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:35.633442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17decf13-00a3-41b0-a5a6-6cd3aa7540cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:35.643920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17decf13-00a3-41b0-a5a6-6cd3aa7540cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-17decf13-00a3-41b0-a5a6-6cd3aa7540cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:35.649609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:35.650457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:35.651232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 186/360] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:57:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:35.657913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:35.752753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:35.769848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0842e-655b-4cc8-9a1a-c9c652044388 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:35.807049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:35.807722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:35.808015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:35.808286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:35.808953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:35.809255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:35.810624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fbce2-aabe-403c-a4ab-f0c7950bedd4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:35.819623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 175/361] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:37.194189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed83191-c5ed-4bd2-9192-fa285f41508c None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.194757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed83191-c5ed-4bd2-9192-fa285f41508c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.194757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed83191-c5ed-4bd2-9192-fa285f41508c None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.196323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 187/362] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:37.209158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01df66-7dd5-4b40-9c98-a2f3b23019eb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.209604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01df66-7dd5-4b40-9c98-a2f3b23019eb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.209683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01df66-7dd5-4b40-9c98-a2f3b23019eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.236851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9a01df66-7dd5-4b40-9c98-a2f3b23019eb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:37.238106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9a01df66-7dd5-4b40-9c98-a2f3b23019eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:37.324535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 176/363] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:37.440690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1f24-4fb8-417f-be0d-de52e863612b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.441026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1f24-4fb8-417f-be0d-de52e863612b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.441223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1f24-4fb8-417f-be0d-de52e863612b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.442815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 188/364] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:37.448350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb2c2-85d2-440c-82d8-f69d2b29f157 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.448602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb2c2-85d2-440c-82d8-f69d2b29f157 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.448823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb2c2-85d2-440c-82d8-f69d2b29f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.472188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e9abb2c2-85d2-440c-82d8-f69d2b29f157 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:37.473994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e9abb2c2-85d2-440c-82d8-f69d2b29f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:37.558844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 177/365] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:37.612922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b9aca-8d19-47c1-8875-7775ee271cf0 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.613251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b9aca-8d19-47c1-8875-7775ee271cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.613472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b9aca-8d19-47c1-8875-7775ee271cf0 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.615654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 189/366] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:37.622025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.622552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.623039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.638052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:37.648364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:37.649829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:37.688692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b9aca-8d19-47c1-8875-7775ee271cf0 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:37.742771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 178/367] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:37.845109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b9aca-8d19-47c1-8875-7775ee271cf0 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:37.887769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:37.889091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:37.890145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:37.890419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:37.890690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:37.912667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:37.917594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:37.918554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:37.920039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 190/368] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:37.924501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:37.982921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.036728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee01671-f2b7-4984-bc5f-f53f6f25ee05 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.050753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5782-e0bb-4f4c-b78c-4ebd2cb1f5ea None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.072660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.073262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.073538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.073807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.074612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:38.074916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.076414 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.085196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 191/369] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:38.085983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.090531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.091191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.091521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.091775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.094598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.104014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:38.109373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:38.110434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:38.111233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 179/370] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:38.116115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.198005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc152b-b7b4-4c60-9656-b5dc1c7f91aa None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.210250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.226736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735ac48-c8f7-4851-b6de-74a8835ae60e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.236866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.237439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.237818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.238091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.249761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:38.256273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:38.258441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 192/371] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:38.260377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.267661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.267661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.267661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.267661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.276179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.277707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:38.294095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:38.296767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:38.298977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:38.298977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:38.298977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:38.298977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 180/372] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:38.307463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.351376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.363780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806409d4-50b6-4917-9c34-4d093ae20f9c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.398697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.399304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.399629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.399900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.400554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:38.400855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.402214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.406600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11833cf4-7857-4b56-8d58-c540d3f3cd66 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.412880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 193/373] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:38.416311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.445498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.446249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.446665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.447042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.447636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:38.447941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.448616 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.449320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f078e9-25aa-47a1-9c01-8774fe5fcfb7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.462261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 181/374] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:38.463570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1869-9a25-4009-90a8-50f13762aec0 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.463861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1869-9a25-4009-90a8-50f13762aec0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.464160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1869-9a25-4009-90a8-50f13762aec0 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.469581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 182/375] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:38.470338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1869-9a25-4009-90a8-50f13762aec0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.522640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e881b-24cd-46d7-885d-06e3369a5470 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.557227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.557878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.558159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.558485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.559126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:38.559456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.560855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.577373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 194/376] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:38.577373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.580933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1869-9a25-4009-90a8-50f13762aec0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.592472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.616897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.617533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.617811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.618077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.628366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.630355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-a1eb5f9a-cc4d-4784-9a9f-a18d35c0bbbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:38.646602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:38.647694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:38.649205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:38.649205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:38.649205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:38.649205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 183/377] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:38.649418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.649695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.649965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.668724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:38.669941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:38.682942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.693251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff447d1a-391e-40dd-aa1f-d65f5a80f8e4 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.735034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.735716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.736008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.736279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.740401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 184/378] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:38.741069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.762760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.764287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:38.781227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:38.782106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:38.783041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:38.783041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:38.783041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:38.786045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 195/379] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:38.786982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.837763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:38.847432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade97d1-3081-4802-abe8-533e0f4d18c7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.885267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.885891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.886296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.886563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.889699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074e58-a7d5-4162-ae5e-5158189b8ad0 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:38.893578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.895024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c6490963-3c6a-4e8f-9a7f-b7f9a6a1d503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:38.907928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:38.908887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:38.910356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 185/380] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:38.910915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff4f8-302a-4521-9f2b-77f7a992d508 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.910915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff4f8-302a-4521-9f2b-77f7a992d508 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.911040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff4f8-302a-4521-9f2b-77f7a992d508 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.912426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 186/381] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:38.912938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff4f8-302a-4521-9f2b-77f7a992d508 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.929244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:38.929857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:38.930135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:38.930401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:38.931030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:38.931327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:38.932730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:38.945084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 196/382] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:38.950275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:38.953628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.018963 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff4f8-302a-4521-9f2b-77f7a992d508 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.048287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196aa06d-94c1-41a9-a54e-7d5a9628754f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.050359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.050953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.051228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.052037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.052921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:39.053215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.054577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f859823-73d9-41ce-a72b-19a50dc17c54 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.065716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 187/383] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:39.066841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.067692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.067966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.084209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.084719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:39.084827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.085074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.085350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.085895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:39.086064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:39.086367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.087834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.092943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.124684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 197/384] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 12:57:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:39.125323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.151514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 188/385] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:39.152213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.191084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.234128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c534a-abce-4267-9ae2-a60b39202f44 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.265396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258989-1222-41c2-916c-2a07d5f0fb17 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.268673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.269306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.269586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.269860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.277237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.278888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:39.292386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:39.293272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:39.294145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 198/386] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:39.294693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.306635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.307211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.307517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.307790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.317982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:39.322931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:39.323833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:39.324619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 189/387] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:39.325276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.330529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.401240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff8ac-05e5-4236-891f-9297cb5ccca1 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.423935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.434074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5baef-58e1-4478-b33b-c0e20f3c433d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.436329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.436950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.437224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.437491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.446115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.447585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:39.458972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:39.459929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 199/388] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:39.460806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.469426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.470048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.470324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.470591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.481113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.482550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:39.497234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:39.498909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:39.498909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:39.498909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:39.498909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 190/389] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:39.499513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.551966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.562147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310853-d09a-4b48-92c4-cf296fd41f6e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.594883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.595505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.595702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6677-9ead-4ceb-a779-819941aaa7cd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.595793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.596038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.596752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:39.597063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.599047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.616713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 200/390] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:39.617561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.632499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.633124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.633399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.633666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.634326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:39.634621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.636014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.643609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 191/391] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:39.644375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.663066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.721705 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d8e17-f2aa-4676-baa7-ec44aaa6d692 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.742921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a513a6-f874-4f4f-a6ef-3f8a04bc23ee None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.757037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.757658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.757931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.758175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.758305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.767989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.769433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.776692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.777315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.777593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.777872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.778586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:39.778921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.780370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:39.784062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:39.785106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:39.786672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:39.786672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:39.786672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:39.787682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 201/392] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:39.788400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.816580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 192/393] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:39.817353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.874570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:39.884057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302a9a-a655-439a-96ac-bf20b1c13a41 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.912144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522910c4-96df-47b5-a850-42f5fadbf98e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:39.916155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.916757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.917033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.917302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.917931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:39.918231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.919621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.930992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 202/394] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:39.931793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:39.948498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:39.949113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:39.949388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:39.949660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:39.959958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:39.961421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:39.975486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:39.976506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:39.977350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:39.977350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:39.977350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:39.977350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 193/395] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:39.977557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.003505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.030174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba468-2e0f-4e29-92cb-c754edec3284 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.062878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.063526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.063805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.064077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.073710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab70687-007d-4481-a9f8-98aa2bd270a6 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.074372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.075854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:40.090600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:40.091675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:40.092504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:40.092504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:40.092504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:40.092504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 203/396] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:40.092504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.096297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.108325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.108921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.109198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.109465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.110102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:40.110397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.111786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.123196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 194/397] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:40.124076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.188577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b232376-f2aa-4e42-9350-25de1aa7fee8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.207062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.222089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955d3b-240b-4066-816c-5e22587d1a50 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.223131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.223831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.224106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.224375 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.234227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.235715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:40.250426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:40.251379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:40.252382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:40.252382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:40.252382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:40.252382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 204/398] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:40.252599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.259169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.259826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.260103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.260371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.266869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.268341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:40.281530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:40.282353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:40.283164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 195/399] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:40.284297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.309853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.352915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc3f3f-6d73-472f-9f6e-a650b356f494 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.381317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5ea62-c002-4dde-bdbd-d803ac85f147 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.384714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.385313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.385587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.385854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.386482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:40.386777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.388176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.400309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 205/400] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:40.404248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.414985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.415613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.415895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.416167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.416808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:40.417106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.418476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.429766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 196/401] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:40.430541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.440426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.500487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc9597-13f6-4b50-a03d-901dc2d230be None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.516023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.527758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028cc75-4497-414d-9828-bc65efe16f49 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.535036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.535678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.536537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.536805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.537436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.538852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.558889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 206/402] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:40 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:40.559769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.561671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.562271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.562556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.562824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.563508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:40.563812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.565231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.578293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 197/403] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:40.579206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.659612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.686272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc3912-03dc-4c22-93be-96ecd9bc9dcb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.703641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1fb8c-626f-4495-9455-f984f9ed147b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.735123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.736051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.736338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.736614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.737310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:40.737621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.739083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.745057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.745685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.745960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.746228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.753543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.755576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.757719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 207/404] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:40.758434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:40.767815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:40.768692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:40.769509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:40.772322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 198/405] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:40.773289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.797686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.876685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792fc6-49bc-4eb6-adbd-d071b296c3d8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.877191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9b4a-3930-4d97-a98d-420382eff07f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:40.903092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:40.912547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.913104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.913535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.914315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.914487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:40.915147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:40.915365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:40.917002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:40.923801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.925279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.928014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:40.929445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:40.937631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:40.938452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 199/406] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:40.944277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:40.944767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:40.945526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 12:57:40.946358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:40.947962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 208/407] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:40.948180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.046994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.051219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc82a9-2c28-4156-a043-3257c4096827 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.057127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40b628-320f-4f29-9962-480b2d6e4dc8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.086756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.087679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.088342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.088628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/74ff7e343a5e4aff9c4a52d1aa0332bc/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.093660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.094274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.094556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.094831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.095548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:41.095857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.097717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.104027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=74ff7e343a5e4aff9c4a52d1aa0332bc, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.106372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.115236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 209/408] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:41.115236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.127925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 200/409] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:40 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/74ff7e343a5e4aff9c4a52d1aa0332bc/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:41.128971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.181913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.250038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76317e84-957d-44c1-9cb4-4bfc92a4df38 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.270226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed815ca-e3d7-4667-ad9c-489825f410f7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.288905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.289634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.289969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.290314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.291133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:41.291550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.293231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.313635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 210/410] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Oct 13 12:57:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:41.314348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.314471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.315228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.315731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.316159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.317557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:41.318015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.320216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.331900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.341358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 201/411] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:41.342052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.450486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592cdd-5d59-4538-b6c7-e0fe3e6933de None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.452213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.462119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53599-b22c-4c3c-94a3-0c9c7f520428 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.496440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.497151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.497435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.497708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/5fc9d2d85fbd449c86ea50f1d46ce009/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.499074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.499720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.499999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.500262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.510511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.511997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.515173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=5fc9d2d85fbd449c86ea50f1d46ce009, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.516655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:41.527738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:41.528648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:41.529454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:41.529454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:41.529454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:41.529454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 202/412] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:41.530075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.538246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 211/413] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:41 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/5fc9d2d85fbd449c86ea50f1d46ce009/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:41.540156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.617026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.649300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06150534-7619-4cb1-b93d-b5c069e2e331 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.664915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278f5ae-5b6b-4330-a317-0cc80f5effdc None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.688617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.689382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.689715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.689988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/a96fabf57bae435eaf4b6c61cbb89346/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.701803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.702338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.702617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.702891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.703655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:41.703990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.705388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.706685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=a96fabf57bae435eaf4b6c61cbb89346, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.708796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.719688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 212/414] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:41.726010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:41.731582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.739447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 203/415] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:41 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/a96fabf57bae435eaf4b6c61cbb89346/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:41.882185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7293fe-8822-42d6-a08b-3f04cae6c692 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:41.906034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:41.922259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:41.922910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:41.923182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:41.923475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:41.931514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:41.932985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:41.945101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:41.945950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:41.946758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 213/416] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:41.951899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:42.060256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e32a-da8f-4c6d-913a-05b3a062e5bd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:42.096894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:42.097848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:42.098949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:42.099441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:42.100322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:42.105383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:42.107650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c364d6e-cbe4-4fb9-9143-4431a5d802ad None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:42.120024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 204/417] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:42.125877 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:42.237463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c487-97c9-4a35-b865-0bf826c328fc None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:42.272370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadfc44-4bd2-400d-9951-663920525d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:42.273151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadfc44-4bd2-400d-9951-663920525d81 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:42.273351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadfc44-4bd2-400d-9951-663920525d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:42.273658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadfc44-4bd2-400d-9951-663920525d81 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/0fd9d9e53d0f4a2ca149de05ff08d81c/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:42.288606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadfc44-4bd2-400d-9951-663920525d81 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=0fd9d9e53d0f4a2ca149de05ff08d81c, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:42.290431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadfc44-4bd2-400d-9951-663920525d81 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:42.305998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 214/418] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:42 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/0fd9d9e53d0f4a2ca149de05ff08d81c/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:42.802399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4212-4a9c-4b3f-9a8c-b51f27a45e24 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:42.802899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4212-4a9c-4b3f-9a8c-b51f27a45e24 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:42.803002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4212-4a9c-4b3f-9a8c-b51f27a45e24 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:42.804577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 205/419] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:42.813255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:42.813547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:42.813818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:42.843144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:42.844433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:42.874510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:42.932805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 215/420] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:43.325833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a4212-4a9c-4b3f-9a8c-b51f27a45e24 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:43.387982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:43.433993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a4212-4a9c-4b3f-9a8c-b51f27a45e24 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:43.469036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:43.470235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:43.470711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:43.471202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:43.486360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:43.491770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:43.492622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:43.493408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:43.496038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 206/421] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:43.501942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:43.614264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040de54-43af-4a4f-a909-85db1cdea2b6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:43.657099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:43.658224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:43.658692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:43.659151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:43.660083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:43.660575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:43.662225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:43.674421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 216/422] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:43.680514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:43.824593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2559bf5-98ae-4c2b-8499-fd35e092bfdf None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:43.845423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:43.862376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:43.863002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:43.863279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:43.863576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:43.874393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:43.875809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-f3836665-85b0-437d-bbb9-95d7022ec99a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:43.890734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:43.891700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:43.892513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:43.892513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:43.892513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:43.892513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 207/423] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:43.899110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:43.946744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:44.058192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d82b2-eb24-4d72-8c4b-63b9471fdffc None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:44.069539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5b771-a59b-4d8d-9243-a3c864787cf8 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.069818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5b771-a59b-4d8d-9243-a3c864787cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.070093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5b771-a59b-4d8d-9243-a3c864787cf8 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.071932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 208/424] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:44.084947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.085230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.085502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.101141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:44.102067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.102537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.103022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.103894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:44.104399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:44.106153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:44.121239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 217/425] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:44.125769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:44.125769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:44.126936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:44.233048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 209/426] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:44.252219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:44.272673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53141e-8103-4cc0-95bd-b84c2509c2ee None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:44.308523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:44.309148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.309422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.309690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.317049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:44.318484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:44.330201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:44.331081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:44.331985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 218/427] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:44.339159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:44.483090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af765d08-e79b-44bd-988f-acc16deb084b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:44.491945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:44.519681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:44.521193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.521669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.522152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.523063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:44.523585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:44.525208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0efd5-e0ab-43b1-b6d4-330b2b95885c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:44.544402 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 210/428] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 12:57:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:44.550291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:44.576482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b23dd-54cc-46e4-a1fc-89aa0e158135 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.576772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b23dd-54cc-46e4-a1fc-89aa0e158135 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.577037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b23dd-54cc-46e4-a1fc-89aa0e158135 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.578638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 211/429] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:44.584170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd2038-43f8-4260-a219-0c51e40ae9cd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.584455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd2038-43f8-4260-a219-0c51e40ae9cd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.584729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd2038-43f8-4260-a219-0c51e40ae9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.607472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-32fd2038-43f8-4260-a219-0c51e40ae9cd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:44.608685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-32fd2038-43f8-4260-a219-0c51e40ae9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:44.687877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 212/430] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:44.689266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6e7d-e4a5-466d-ab54-abe91d80febd None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.689555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6e7d-e4a5-466d-ab54-abe91d80febd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.689822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6e7d-e4a5-466d-ab54-abe91d80febd None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.691067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 213/431] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:44.691786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac6e7d-e4a5-466d-ab54-abe91d80febd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:44.717826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f2c7-4d02-4a82-a468-aa979ef71b89 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:44.763000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:44.763582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.763862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.764139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.779762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:44.781552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:44.783864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-928fb78e-0054-47fe-a8b4-56c660d47ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:44.805252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:44.806223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:44.807046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:44.807046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:44.807046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:44.809484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 219/432] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:44.811277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100d9b-b883-48c5-9fa4-4c2599d2d990 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.811859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100d9b-b883-48c5-9fa4-4c2599d2d990 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.812274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100d9b-b883-48c5-9fa4-4c2599d2d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.823784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:44.831566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac6e7d-e4a5-466d-ab54-abe91d80febd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:44.837310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f2100d9b-b883-48c5-9fa4-4c2599d2d990 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:44.838969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f2100d9b-b883-48c5-9fa4-4c2599d2d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:44.883212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:44.884280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.884678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.885070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.899055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:44.905075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:44.906124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:44.907135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:44.911006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 214/433] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:44.911864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:44.925195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 220/434] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:44.927454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc19d1-edd2-4d7e-b5c6-75bc3b9d2020 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:44.927743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc19d1-edd2-4d7e-b5c6-75bc3b9d2020 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:44.928010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc19d1-edd2-4d7e-b5c6-75bc3b9d2020 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:44.931438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 221/435] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:44.931438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc19d1-edd2-4d7e-b5c6-75bc3b9d2020 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.017059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f47a2-5de6-462a-8846-8a27c384895f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.036650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc19d1-edd2-4d7e-b5c6-75bc3b9d2020 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.051767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.052630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.052907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.053173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.053821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:45.054122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.055507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ab67-d185-46cd-9d37-36ca66eb99e8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.066695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 215/436] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:45.068249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.068534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.068870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.072304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.085803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.086410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.086538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:45.086714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.086957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.087654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:45.087749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:45.087956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.089298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.089724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.104872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 222/437] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:45.105733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.158265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 216/438] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:45.161095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.210211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceb62d-e926-4770-9085-390d5a9b9f54 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.244189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.244815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.245092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.245372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.255909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:45.261895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:45.262848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:45.263667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 223/439] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:45.264305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.277353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a77d0-c6e5-4907-a1ca-83dbc625ad7f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.312754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.312921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.313373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.313658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.313925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.321340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.322791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.324486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:45.335084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:45.336032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:45.337006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 217/440] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:45.337515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.378601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae784-34f1-4c3b-94dd-5045c1463bcb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.414392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.415223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.415776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.416215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.428417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.430361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.434618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06e3c-7dd1-4ed1-8e54-de32d65cfcc2 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:45.444417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:45.445359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:45.446230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:45.446230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:45.446230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:45.446230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 224/441] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:45.446440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.470033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.470649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.470922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.471185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.482416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:45.487194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:45.488287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 218/442] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:45.489127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.542897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.546598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.547045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cca4e9-ba95-49db-b360-28b1850cbbe6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.579358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.579987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.580269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.580544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.581231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:45.581542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.583499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.587635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20974e7-32c9-4c67-8ea9-39fa3e92e399 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.591115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 225/443] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:45.595278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.621076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.621673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.621956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.622232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.622915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:45.623219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.624674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.636188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 219/444] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:45.636916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.689918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490fcf-012d-4489-92e2-93e00c7b9af5 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.722361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.722993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.723917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.724189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.734102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:45.737495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1e42-3666-4823-9c24-09aeab270076 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:45.739880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:45.740744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:45.741512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 226/445] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:45.742230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.757324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.764726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.775025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.775665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.775951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.776225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.776864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:45.777170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.778557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.790398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 220/446] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:45.791220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.842065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754ba8e-5ee0-4600-93e7-c5c4daa492ad None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.874568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.875168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.875472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.875751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.876406 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:45.876709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.878072 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.886685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 227/447] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:45.887464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.893501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aea28-88d1-4dc1-9dc6-94f1d988a028 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:45.927494 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:45.928106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:45.928375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:45.928637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:45.938392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:45.939857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:45.954078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:45.954950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:45.955810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:45.955810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:45.955810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:45.955810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 221/448] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:45.956021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:45.971938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.989950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:45.992455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3ae2-8fb1-42b0-868d-00335e7ba2cb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.024999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.025643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.025918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.026187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/62bb121942c94956b40024757f89a5c1/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.040429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=62bb121942c94956b40024757f89a5c1, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.041874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.054770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 228/449] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:45 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/62bb121942c94956b40024757f89a5c1/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:46.056256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.057551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7a49-324f-44bc-a573-ae1ae28d4f0e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.093828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.094358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.094679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.094947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.095686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:46.095992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.097416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.111481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 222/450] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:46.111481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.177682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f467-153f-48d8-8dac-f220137c1c88 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.213113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.216124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.223741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05358-9b09-4537-b808-db662981a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.223910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc089be2-2bff-4375-8725-b673e5e1fb3b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.224838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05358-9b09-4537-b808-db662981a508 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.225278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05358-9b09-4537-b808-db662981a508 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.225954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05358-9b09-4537-b808-db662981a508 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.234752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d05358-9b09-4537-b808-db662981a508 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.236232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d05358-9b09-4537-b808-db662981a508 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-66d05358-9b09-4537-b808-db662981a508 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:46.250223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:46.251162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:46.252114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 229/451] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:46.252651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05358-9b09-4537-b808-db662981a508 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.262008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.262644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.262975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.263253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.277254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.279443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:46.297476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:46.298396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:46.299250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:46.299250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:46.299250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:46.299250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 223/452] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:46.299501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.364023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05358-9b09-4537-b808-db662981a508 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.400670 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.401610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.402107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.402639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.403617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:46.404119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.405715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.405819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b26e-ff62-4871-a621-e7af7ad2e6d1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.419444 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 230/453] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:46.419710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.446235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.446865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.447255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.447561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.459169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.460781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.463542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.474234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:46.479207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:46.480289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:46.481374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:46.481374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:46.481374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:46.484956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 224/454] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:46.485822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.526456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eec27-7209-44cc-9177-c2317a7ca9d9 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.561790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.562396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.562673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.562943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.563689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:46.563997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.565428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.583318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 231/455] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:46.584265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.600492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dce7-ee1e-4905-b013-7bffede8d978 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.641030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.641580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.641860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.642129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.642764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:46.643065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.644492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.657076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 225/456] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:46.657781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.692348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5ac42-ed6d-4b5a-bb9a-9debb8757c72 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.704446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.718409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.737451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.738091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.738464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.738766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.746107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.747579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:46.760922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:46.761841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:46.762685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 232/457] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:46.763256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.775194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd0f1-d02f-4a9b-9011-fdc35a46e3d0 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.813770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.814363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.814638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.814909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.815635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:46.815937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.818000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.829194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 226/458] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:46.833451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:46.866879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59291842-3f75-4fdb-9ac9-d809dc4ce38d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.902431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.902965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.903264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.903538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.945353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19550-14dc-47ad-ad3b-739581ff615a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:46.946945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.963092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:46.980455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.980867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:46.981486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:46.981763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:46.982031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:46.982122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:46.991347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:46.993226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:47.005632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:47.006491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:47.007367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 227/459] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:47.008694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.091644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 233/460] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:47.091644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.110107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385b43-72e8-4bbd-9f99-5aada5fbf72a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.146137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.147110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.147388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.147689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.148404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:47.148711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.150168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.166107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.167332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 228/461] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:47.168169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.202874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3c5c-7f80-4105-9cc9-d24484ef808e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.212198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.237409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.238031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.238306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.238561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.247140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.248607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:47.260104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:47.260990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 234/462] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:47.262422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.289237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c26cb-80fd-4493-85ac-f0ad3f90949d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.325158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.325860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.326205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.326563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.327436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:47.327670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.329087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.352352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 229/463] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:47.352352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.369635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2f49-12bb-40a6-bc19-476ebd2d08af None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.397778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.403642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.404269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.404551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.404825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.415342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.416901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:47.431033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:47.432139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:47.433173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:47.433173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:47.433173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:47.433173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 235/464] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:47.433395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.454269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.465174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7148c2a-a059-45e1-91c9-c8feee2cc890 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.502276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.503019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.503603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.503876 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.540366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd941ca7-10ca-464d-83e5-a1ba39e55542 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.575495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.576577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.576997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.577532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.579043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:47.579506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.581289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.584856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.586312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.603904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 236/465] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:47.605360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.658793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.678174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.694513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 230/466] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:47.695251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.728718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3932b-9772-45e6-a83e-90b621fa251d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.764919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.765666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.766041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.766453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.802566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695844-a5b7-4a73-9082-026618ea2ea4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.835597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.836068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.836449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.836823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.837186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:47.837535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.838003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:47.838392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:47.839850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:47.851008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 231/467] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:47.851967 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.884677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.905274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:47.948906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 237/468] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:47.950077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:47.958221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f7efc-27f0-443b-a342-6cfae5cae887 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:47.990848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:47.991528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:47.991815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:47.992089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.054255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061da9-572a-4925-986f-a8a1bbc171e5 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.060344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.061850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.089671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.090412 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.090765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.091110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.101160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.104542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.106382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.118924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:48.122647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:48.123561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:48.124394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:48.124394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:48.124394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:48.124394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 238/469] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:48.124599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.170775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 232/470] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:48.171636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.232979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4406be-99cd-4afc-a84e-0dc76d472658 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.264712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.265331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.265603 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.265873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.270003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8a2d3-75cc-488f-8fa0-4bb4d187f745 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.272260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.273675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:48.284542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:48.286082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:48.286939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:48.290811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 239/471] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:48.291648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.305750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.306372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.306645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.306913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.316442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.317887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:48.332828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:48.333888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:48.334703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:48.334703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:48.334703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:48.334703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 233/472] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:48.334703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.339263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.343982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.390826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8090381-ca0f-469c-85c0-eacd6db7651c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.423757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.424356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.424631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.424902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.425534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:48.425832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.428079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ab360-09a3-4c0a-9010-a1097f672521 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.435631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517532c-1782-4e2d-a505-0adb1235c1a8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.439501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 240/473] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:48.440663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371558-abb0-49c2-9e9c-58a42467a8a6 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.440956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371558-abb0-49c2-9e9c-58a42467a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.441229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371558-abb0-49c2-9e9c-58a42467a8a6 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.442425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 241/474] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:48.443118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a371558-abb0-49c2-9e9c-58a42467a8a6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.470568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.471189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.471497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.471784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.484333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.485720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:48.499436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:48.500447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:48.501455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:48.501455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:48.501455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:48.501455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 234/475] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:48.501455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.545479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a371558-abb0-49c2-9e9c-58a42467a8a6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.555248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.558568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.579409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.580023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.580298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.580564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.581238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:48.581540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.583563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.594535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 242/476] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:48.595299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.599886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e963e6-2016-4c05-a8b8-8cea960fc9fd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.632220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.632821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.633098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.633370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.634003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:48.634305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.635701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca0ff-20bd-4fa9-961c-1a2532904a99 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.647317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 235/477] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:48.648630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.649058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.649327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.666560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:48.667770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:48.697829 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440045c-57b7-4cee-84e5-1e0e7d3528e6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.733235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 236/478] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:48.734072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.740230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.740806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.741088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.741362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.757227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.758786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:48.770721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:48.771745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:48.772794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:48.773706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 243/479] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:48.779030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.781876 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.814219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:48.839288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e03a1-c9bb-480e-8c0d-5cb563316d58 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.873560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.874165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.874445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.874716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.875350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:48.875678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.877050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.889687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 237/480] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:48.890515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:48.896912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf368d-afde-433b-8c2a-f71817cda261 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:48.932133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:48.932861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:48.933237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:48.933607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:48.934552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=74ff7e343a5e4aff9c4a52d1aa0332bc) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:48.934967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:48.936640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:48.955433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 244/481] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/role_assignments?user.id=74ff7e343a5e4aff9c4a52d1aa0332bc&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:48.955433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.012551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87292801-fed4-4332-b413-6b2e6743af83 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.020815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.049471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.050123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.050400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.050668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.058837 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.060339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.064999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.072282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd4a5a-7025-492f-a737-bc1face3e980 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:49.072966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:49.073774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:49.074598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 238/482] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:49.075040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.114399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.115024 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.115305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.115656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.116390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.116700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.118164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.132103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 245/483] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.132874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.192463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3ac6-d002-4ed3-8465-68ba2b83dc36 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.227617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.228251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.228539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.228816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.235572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.237018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.243009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3137-e195-42fe-93cf-e331fb647faf None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:49.248548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:49.249417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:49.250254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 239/484] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:49.250701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.279656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.283707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.284427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.284857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.285131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.295609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:49.300447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:49.302042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:49.303272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:49.307169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 246/485] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:49.308053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.327450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.361989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61c22f-079d-45b1-82db-48624e230d4b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.397968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.398680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.398965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.399364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.400060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.400366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.401986 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.414274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c82ff4-44b9-40bf-be4d-286026219a58 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.420014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 240/486] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.420014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.455343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.455986 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.456263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.456535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.457253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=5fc9d2d85fbd449c86ea50f1d46ce009) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.459307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.459307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.475432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 247/487] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/role_assignments?user.id=5fc9d2d85fbd449c86ea50f1d46ce009&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.475432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.535776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.559821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093edcd-2afb-44c1-94f7-9e946c6e9fb4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.570076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.592577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a141d-52ce-4323-8fdb-b7fbfcbb646d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.609690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.610569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.610847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.611125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.612120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.612425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.615049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.632178 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.632937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.633173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 241/488] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.633407 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.633779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.634036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.634740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.635176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.636719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.651266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 248/489] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.651266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.774951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f116e4-7956-42a8-b4fe-236a04e93de0 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.786949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197070-66f5-4052-af7f-73104fdf8aa7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.813204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.813963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.814361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.814766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.815593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=0fd9d9e53d0f4a2ca149de05ff08d81c) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.816001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.817564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.823753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 249/490] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/role_assignments?user.id=0fd9d9e53d0f4a2ca149de05ff08d81c&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.824726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:49.830701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.831664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.832086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.832549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:49.833442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=a96fabf57bae435eaf4b6c61cbb89346) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:49.833900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:49.836359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:49.839034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:49.845678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 242/491] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/role_assignments?user.id=a96fabf57bae435eaf4b6c61cbb89346&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:49.951781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50fcb-8d15-4d2f-b3b1-efe099be466a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:49.997925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:49.998771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:49.999151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:49.999572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:50.021308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:50.022973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:50.039634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:50.040749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:50.042262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:50.042262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:50.042262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:50.043222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 250/492] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:50.048587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:50.067854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:50.162041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592434d-1b10-4cff-a974-742f2d2bd388 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:50.206689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:50.208086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:50.208523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:50.209004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:50.209795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:50.210297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:50.211879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:50.225976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 243/493] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:50.231561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:50.294542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:50.340046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558d98b-874e-41df-b933-9c7f534467ae None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:50.375896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:50.376765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:50.377220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:50.377655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:50.386390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:50.388258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:50.400720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:50.401820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:57:50.402893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:50.404892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 251/494] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:50.411045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:50.485262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:50.518914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147ab6-a0f3-43a8-ba8e-b6bf70f451f2 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:50.556006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:50.556837 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:50.557271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:50.557679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:50.558617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:50.559151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:50.560748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:50.580152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 244/495] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 12:57:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:50.586567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:50.695770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092386a-f0fb-4311-b706-b268f5ce5164 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:50.714433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:50.741216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:50.741886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:50.742169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:50.742436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:50.826291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:50.827770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:50.936727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 252/496] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 12:57:50.942936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:51.046912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de2b10-e45a-4f85-8731-5cbfd63b6dbd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:51.075348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:51.084359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:51.084926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.085205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.085479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.095894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:51.097479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:51.113341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:51.114972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:51.115865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:51.115865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:51.115865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:51.115865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 245/497] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:51.121421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:51.141040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:51.236129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c4487-a054-4fb5-8391-fd6af5342947 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:51.271787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:51.272458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.272789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.273055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.273751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:51.274054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:51.275473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce559fc-c118-4c13-989e-80076318ff19 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:51.290116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 253/498] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:51.295575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:51.373044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa257d-2afd-4ca6-9352-e1a8d939a515 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.373333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa257d-2afd-4ca6-9352-e1a8d939a515 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.373516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa257d-2afd-4ca6-9352-e1a8d939a515 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.375834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 254/499] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:51.379594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.379881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.380160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.398674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d93a5-374e-4056-928c-24901ca5d9b6 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:51.415627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:51.416844 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:51.437073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:51.437701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.437975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.438294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.445776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:51.447289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:51.459999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:51.460959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:51.462286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 246/500] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:51.466802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:51.515796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:51.577623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf81b7b-3ed9-41d0-81c4-dd900b180a35 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:51.608018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 255/501] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:51.616841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:51.617441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.617717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.617985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.618665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:51.618966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:51.620426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:51.633494 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 247/502] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:51.639293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:51.650610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:51.746204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae821f8-8330-448f-8757-fb9b7bb9f067 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:51.781660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:51.782359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:51.782642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:51.782959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:51.783766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=62bb121942c94956b40024757f89a5c1) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:51.784070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:51.786110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:51.792513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 256/503] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:57:51 2022] GET /identity/v3/role_assignments?user.id=62bb121942c94956b40024757f89a5c1&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:52.056507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:52.157389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:52.160255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a850e-5034-45b1-b465-233d3079cb4b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:52.199306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55761ed-2b0f-4c38-9bc2-a4b8aa239cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:52.199993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55761ed-2b0f-4c38-9bc2-a4b8aa239cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.200268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55761ed-2b0f-4c38-9bc2-a4b8aa239cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.200542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55761ed-2b0f-4c38-9bc2-a4b8aa239cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.213700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55761ed-2b0f-4c38-9bc2-a4b8aa239cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c55761ed-2b0f-4c38-9bc2-a4b8aa239cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:52.218716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:52.219747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:52.220570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 248/504] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:52.227177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:52.299610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:52.316411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f44ba-b1ed-4dbd-aecc-1d2a6a49df3e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.316775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f44ba-b1ed-4dbd-aecc-1d2a6a49df3e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.317480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f44ba-b1ed-4dbd-aecc-1d2a6a49df3e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.320083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 249/505] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:52.325276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.325559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.325833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.343916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c8b8-30c4-4a4a-ade2-d7515e452571 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:52.346672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:52.348094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:52.382206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:52.383067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.383529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.384109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.385204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:52.385654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:52.387206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:52.396986 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 257/506] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:52.402957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:52.472255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 250/507] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:52.585264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c315-ed15-427b-8f23-a63fbccf3440 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:52.620202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:52.620824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.621099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.621371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.623266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:52.633086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:52.634540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-604668a3-2284-4946-add5-168c50e04fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:52.649234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:52.650206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:52.651150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:52.651150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:52.651150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:52.655235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 258/508] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:52.656619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:52.673938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f103-de68-4053-a794-c24e1fea1134 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.674235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f103-de68-4053-a794-c24e1fea1134 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.674528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f103-de68-4053-a794-c24e1fea1134 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.676079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 259/509] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:52.681687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ead33-c321-4012-82c6-79b18adc680b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.681970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ead33-c321-4012-82c6-79b18adc680b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.682240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ead33-c321-4012-82c6-79b18adc680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.712944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-921ead33-c321-4012-82c6-79b18adc680b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:52.714202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-921ead33-c321-4012-82c6-79b18adc680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:52.788373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 260/510] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:52.797931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ead33-c321-4012-82c6-79b18adc680b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:52.834604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c29af-73f0-480d-aab3-65243c2f56d2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:52.852079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:52.877750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:52.878733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.879222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.879544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.880465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:52.880778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:52.882322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6281d-3ffe-421e-b88c-73d8570fbfc5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:52.901662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 251/511] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:52.903066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267032fb-c4e8-4700-8fe9-9463645da3f1 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.903352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267032fb-c4e8-4700-8fe9-9463645da3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.903667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267032fb-c4e8-4700-8fe9-9463645da3f1 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:52.909770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 252/512] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:52.909770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267032fb-c4e8-4700-8fe9-9463645da3f1 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:52.944736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ead33-c321-4012-82c6-79b18adc680b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:52.979122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:52.983352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:52.984826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:52.985420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:52.985927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.001272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.002776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-7066640e-57f2-4f9b-9280-96f4383988d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:53.019113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:53.020772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:53.021693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:53.021693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:53.021693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.021693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 261/513] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:53.022418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.022701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.023291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.033263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267032fb-c4e8-4700-8fe9-9463645da3f1 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.042789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:53.044171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:53.069039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.069888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.070324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.070770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.079429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.081121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:53.093351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:53.094289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:53.095183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 253/514] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 12:57:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:53.095800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.109883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:53.127455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 262/515] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:53.127455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.228123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8489ac-aa84-4cf8-899e-cf9a53e48a64 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.241150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:53.247499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f004dac-eb4d-4105-a73a-bf0b3aabfebe None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.264668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.265365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.265755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.266092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.266800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:53.267459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.268650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.281184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 254/516] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:53.282206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.292458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.293778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.294245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.295121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] PATH_INFO: `/v3/services/network` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.296263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.298080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:53.314386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:53.315372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:57:53.316312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.317090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 263/517] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:53.317994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.358822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:53.392620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f968f-68c8-4e61-aa45-b7479210e89c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.433200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.433795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.434068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.434333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.435078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:53.435859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.436836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.448275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b419a-cf6b-4381-9519-0b19850912eb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.457128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 255/518] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:53.458117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.488248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.489226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.489682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.490154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.490962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.492615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.515201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 264/519] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:57:53 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:53.516380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.545732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:53.600741 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0f568-c83a-472b-952f-1e26a999f300 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.639249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:53.647757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dde317-32c1-4877-9e95-ee084c93474c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.651862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.655685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.656090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.656435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.657817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] RBAC: Adding query filter params (name=network) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:53.658213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.659759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.673132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 256/520] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:53.674679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.696104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.696976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.697411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.697861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.698450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.700692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:53.711440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:53.712453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:53.713284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 265/521] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:53.714062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.814894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:53.826410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7366b91-25ff-45cb-b7f6-53fa7ef392cd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.841456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed9d7-4e98-4a88-b2c7-af023038c07b None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:53.864354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.865707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.866531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.866886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.880213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.882611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.887314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:53.888204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:53.888667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:53.889118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:53.890478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] RBAC: Adding query filter params (type=network) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:53.890983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:53.893074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:53.900314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:53.901235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:53.902156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:53.902156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:53.902156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:53.902746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 266/522] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:53.903843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:53.906734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 257/523] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:53.915451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:54.014431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:54.108486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc18464-cb04-4166-be6d-91f079da999a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:54.122502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047648-3459-4bf1-b70c-493b471b9302 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:54.149040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:54.150002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.150545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.151040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.152024 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:54.152627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:54.154201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:54.159807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 267/524] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:54.166759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:54.169454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:54.170380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.170664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.170933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.172600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:54.172919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:54.174457 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:54.183292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:54.197341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 258/525] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:54.200497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:54.308177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10000bd-176a-41f0-81e1-11731f590756 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:54.312341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:54.337598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd364-a4db-4a59-b4b3-d266d0dc3b11 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:54.345914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:54.346865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.347351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.348400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.355983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:54.357713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:54.378369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:54.379906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:54.380774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:54.384431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 259/526] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:54.390037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:54.397473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:54.398098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.398374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.398646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.399299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:54.399612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:54.401043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a003730-a5ba-465a-b68f-f4b0eb516a7a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:54.411923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 268/527] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 12:57:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:54.414100 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b814b6-7dd8-4d96-b144-b0e0e09fe413 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.414394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b814b6-7dd8-4d96-b144-b0e0e09fe413 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.414696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b814b6-7dd8-4d96-b144-b0e0e09fe413 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.421034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 269/528] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:54.423147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.423368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.424187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.456969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:54.458801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:54.590163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 270/529] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:54.592962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e155e5-797b-46ea-8897-443ff2b6bfab None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:54.639685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:54.640696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.641183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.641658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.642553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:54.643059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:54.645304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:54.658420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 260/530] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:54.664058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:54.668134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:54.811076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f96315-dc66-470d-8a9f-b5c333f22b69 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:54.860758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:54.861423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:54.861697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:54.861966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/74ff7e343a5e4aff9c4a52d1aa0332bc/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:54.864610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=74ff7e343a5e4aff9c4a52d1aa0332bc, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:54.866175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:54.881631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 271/531] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:54 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/74ff7e343a5e4aff9c4a52d1aa0332bc/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:54.986419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:55.019598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:55.125529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a263f-f54a-4d5f-be38-3edb683afafa None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:55.162396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:55.163362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:55.163904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:55.164381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:55.175024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:55.180577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:55.181497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:55.182330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:55.184946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 261/532] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:55.190862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:55.284676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:55.338435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecf7d8-9789-4b0b-aa72-37b548339370 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:55.383809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:55.384421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:55.384694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:55.384960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:55.385631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:55.385928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:55.387310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:55.402508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 272/533] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:55.408055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:55.515433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:55.533313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a8aba-af6d-421f-8783-653292bdd04f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:55.585576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:55.586597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:55.587108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:55.587614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:55.600873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:55.602670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:55.623306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:55.624312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:55.625179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:55.625179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:55.625179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:55.628927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 262/534] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:55.636478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:55.807545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f33bd-d893-4a48-873c-bed5e49c2662 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:55.846310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:55.863390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:55.864064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:55.864338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:55.864609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:55.865256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:55.865553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:55.866910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347586b7-753c-4379-b75f-54f7aba922bf None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:55.880100 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 273/535] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:55.885774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:55.975916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e3b15-cbf6-4788-a5f5-ab3b2e00f82a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:55.976239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e3b15-cbf6-4788-a5f5-ab3b2e00f82a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:55.976462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e3b15-cbf6-4788-a5f5-ab3b2e00f82a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:55.979037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 274/536] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:57:55.982893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:55.983168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:55.983457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.001814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:56.002990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:56.009409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8691455-a50d-44d8-93b2-c7afbecd1e95 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:56.083507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 275/537] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 12:57:56.084112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:56.084754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.085037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.085311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.096930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:56.100533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:56.102017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:56.125122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:56.126120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:56.127625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 263/538] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:56.132109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:56.275213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5cd3c-c6b5-4309-8fd7-9a4ad634b169 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:56.296629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:56.322919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:56.323562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.323846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.324119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.324855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:56.325161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:56.326600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:56.345595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 276/539] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 12:57:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:56.352519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:56.371295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:56.518836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7990a51-2fde-46da-84cf-5a7ea92b0f9c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:56.557372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8f230-be40-49df-838a-4ec1b6b2b054 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:56.579582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:56.580211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.580485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.580753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.597055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:56.602649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:56.603581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:57:56.604402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:56.605499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 277/540] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:56.614193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:56.620953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:56.621582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.621855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.622119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.640771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:56.642215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:56.664320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:56.665323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:56.666173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:56.666173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:56.666173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:56.667190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 264/541] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:56.677932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:56.688567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:56.773425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:56.807985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdc32-5f83-4c7f-a924-fd2fd136c572 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:56.844008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e19f-c748-4ce9-8a87-3bb06f28bf5d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:56.851937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:56.852865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.853338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.853799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.855031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:56.855604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:56.857793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe92ac-3011-4457-8f2d-9d9309d2bf42 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:56.873627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 278/542] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:56.873627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d67d-8246-4b83-920a-641f2ef7b697 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.873627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d67d-8246-4b83-920a-641f2ef7b697 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.873627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d67d-8246-4b83-920a-641f2ef7b697 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.873627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 279/543] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:56.875866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8d67d-8246-4b83-920a-641f2ef7b697 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:56.895232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:56.896581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.899075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.899559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.902204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:56.902675 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:56.904939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01805b9b-030d-427c-bf28-081a79b7e728 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:56.921878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 265/544] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:56.923529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:56.923940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:56.924334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:56.949390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:56.950826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:57.000317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.009422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8d67d-8246-4b83-920a-641f2ef7b697 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.031427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 266/545] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:57.031427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.062524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.063392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.063925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.064440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.068968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.082578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.084420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:57.114575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:57.115564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:57.116446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:57.116446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:57.116446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:57.122876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 280/546] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:57.126501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.131702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02152-a139-4ef0-bd95-a24db6882567 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.172121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.172121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.172121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.172121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.180397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.187424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:57.194165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:57.195159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:57.196067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:57.200562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 267/547] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:57.201416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.301786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.306605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b5ad6-00c1-4350-85a4-c299cdbf9de4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.326962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18916bf9-165d-4f53-966f-403f56b21997 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.343211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.343888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.344171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.344445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.345165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:57.345476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.346983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c920-c4b0-43aa-9871-c7c411c6b7ed None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.364312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 268/548] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:57.365701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2b50-0d4e-4073-83e1-62f5492c4289 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.365929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2b50-0d4e-4073-83e1-62f5492c4289 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.366201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2b50-0d4e-4073-83e1-62f5492c4289 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.372588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 269/549] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:57.373350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2b50-0d4e-4073-83e1-62f5492c4289 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.380751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.381528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.381873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.382153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.382806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:57.383108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.385165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17632204-806c-4ed5-bd06-0c9d84faceb1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.403878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 281/550] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:57.405866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.406424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.406703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.435378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:57.437145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:57.440011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.483712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2b50-0d4e-4073-83e1-62f5492c4289 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.507635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 282/551] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:57.508545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.519873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.520686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.520974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.521246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/62bb121942c94956b40024757f89a5c1/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.523161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=62bb121942c94956b40024757f89a5c1, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.524688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.537430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 270/552] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:57 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/62bb121942c94956b40024757f89a5c1/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:57:57.538200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.570734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.654838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f7ba6-1d25-4959-8872-04cfb51574bf None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.677765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c16b-cc4f-45fc-9f76-dde578e05dc5 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.708198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.709719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.710149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.710582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.716683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7ea0c-f32c-4362-89db-3823835b2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.717326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7ea0c-f32c-4362-89db-3823835b2956 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.717608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7ea0c-f32c-4362-89db-3823835b2956 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.717883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7ea0c-f32c-4362-89db-3823835b2956 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.718600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7ea0c-f32c-4362-89db-3823835b2956 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.718986 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.720359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7ea0c-f32c-4362-89db-3823835b2956 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.720465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.725023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-78017606-601a-43ed-bf09-77d96322ac4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:57.739396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:57.740525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:57.741715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 283/553] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 12:57:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:57.742396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f840ef-c572-42f9-8b4d-93b2610140eb None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.742396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f840ef-c572-42f9-8b4d-93b2610140eb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.742536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f840ef-c572-42f9-8b4d-93b2610140eb None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.746266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 271/554] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:57:57 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:57.751458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 284/555] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:57:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:57:57.754802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.755331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.755839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.757263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f840ef-c572-42f9-8b4d-93b2610140eb None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.783788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:57:57.786621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:57:57.894177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 272/556] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:57:57 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 12:57:57.894657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f840ef-c572-42f9-8b4d-93b2610140eb None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:57.895632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:57.900747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:57.945382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:57.945945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:57.946267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:57.946540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:57.947268 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:57.947595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:57.949031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:57.968774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 285/557] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 12:57:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:57.978970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.027060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d21d0-15e7-4b37-b563-69a74b3f9a84 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.037854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:58.066218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.067363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.067670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.067941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.068597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.070207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.088885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 273/558] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:57:57 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:57:58.091729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe05d-900a-4e50-bb0e-420edf88e888 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.142276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.142996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.143313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.143574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.154265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.155776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:58.174171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:58.175193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:58.176673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:58.176673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:58.176673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:58.178649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 286/559] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:58.182896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.187368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.300710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42094f24-6b02-45a7-9fac-0f1e2bfe9fee None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.307170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:58.330474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:58.336278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.336919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.337200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.337473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.359381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:57:58.366170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:58.367068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:57:58.367941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:58.370637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 287/560] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:58.376530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.390286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f496c-5243-412e-abf0-1e3b13916cda None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.441346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.442650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.443370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.443859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.445323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:58.445820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.448285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.467439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 274/561] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:58.470057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.497131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fa12e-efd4-411c-ba07-c8084c345106 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.534639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.535242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.535650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.535927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.536600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:58.536930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.538530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.553393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 288/562] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:58.559081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.597123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:58.611111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4fe6-b307-4f70-8555-9a86d88f3acc None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.634103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:58.654112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.654738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.655020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.656110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.668811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.671489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:57:58.688622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:58.689508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:57:58.690747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 275/563] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:58.697369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.735425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b412810-bfe2-4390-9466-0a7a17c21dbc None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.774292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.774930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.775206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.777472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.796913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.799797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:57:58.828245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:58.829203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:57:58.830058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:57:58.830058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:57:58.830058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:58.832645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 289/564] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:57:58.838001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:58.896988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6e982-c78f-4edd-b0cd-a278a24f35ef None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.950339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:58.969202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:58.969834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:58.970115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:58.970388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:58.971112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:58.971425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:58.973159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:58.978400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519efa9-090d-4652-8219-03234f766a41 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:58.987964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 276/565] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:57:58.994257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:59.015130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:59.015974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:59.016256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:59.016525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:59.017323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:59.017622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:59.019038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:59.033323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 290/566] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:59.040502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:59.060226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:59.126201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67151-b774-49b6-9c2c-fe69b1fa9346 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:59.159945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:59.160665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:59.161044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:59.161327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/374c419c61e34718b350e06e35764fb3/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:59.175215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=374c419c61e34718b350e06e35764fb3, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:59.177236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:59.199360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 277/567] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:57:58 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/374c419c61e34718b350e06e35764fb3/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 12:57:59.274349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7f076-a409-44b0-b5ff-92815c2a45ec None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:59.314396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:59.315425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:59.315929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:59.316446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:59.319425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:59.326833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:59.328445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:57:59.341167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:57:59.342181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:57:59.343192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 291/568] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 12:57:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:57:59.348835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:59.489463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90e370-26bd-4d82-8d8c-f18a039322f5 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:59.491972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:59.530688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:59.531316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:59.531632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:59.531908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:59.532654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:57:59.532961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:59.534398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:59.558979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 278/569] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 12:57:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:57:59.564552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:57:59.718236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2a5dc-3d1b-4567-9b87-0b501c97ecbe None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:57:59.777271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444866a-d92c-4824-b441-5149b678235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:57:59.777805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444866a-d92c-4824-b441-5149b678235e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:57:59.778087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444866a-d92c-4824-b441-5149b678235e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:57:59.778362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444866a-d92c-4824-b441-5149b678235e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:57:59.851230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:57:59.859576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444866a-d92c-4824-b441-5149b678235e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:57:59.861448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444866a-d92c-4824-b441-5149b678235e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:57:59.968253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 292/570] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:57:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:57:59.974177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.123246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3790-b7e1-46f5-87aa-71a62fcb65e1 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.123607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3790-b7e1-46f5-87aa-71a62fcb65e1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.123843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3790-b7e1-46f5-87aa-71a62fcb65e1 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.125442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 293/571] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:00.128808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9075f1e-fd08-4853-8be5-055ded1748a4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:00.130493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.130785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.131066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.149139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:00.150348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:00.185515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:00.186174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.186523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.186796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.207183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:00.209418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:00.228410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:00.229474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:00.230343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:00.230343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:00.230343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:00.230343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 279/572] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:00.231503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 294/573] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:00.236293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.244251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:00.370948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494aace-f2c4-4a5b-835d-21f7d7941942 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:00.422076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:00.422611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.422955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.423236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.423917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:00.424219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:00.425595 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536d9d-6907-406e-b4e2-8c822b6042db None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:00.448028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 280/574] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:00.453476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.491221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:00.520751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5142d-25d9-4ff8-930a-f9c7b66c57d6 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.521124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5142d-25d9-4ff8-930a-f9c7b66c57d6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.521474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5142d-25d9-4ff8-930a-f9c7b66c57d6 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.523158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 281/575] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:58:00.528022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.528399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.528746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.546663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:00.547994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:00.585936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fbeaa-5451-4f76-9e4d-c85a08bcdb68 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:00.625557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:00.626193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.626467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.626735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.635435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:00.637164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:00.650808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:00.651710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:00.652752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:00.653268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:00.655520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 295/576] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:00.655520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.663318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 282/577] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:00.664252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.791298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d22d-9b89-4c32-8572-32f8d490f1d7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:00.830462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:00.831073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.831348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.831797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.833091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:00.833400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:00.835117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:00.844167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:00.849198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 283/578] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:00.856336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.879725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff873-13ad-4ce7-b5a6-b194cc0de73f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:00.925175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:00.926604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:00.926887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:00.927157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:00.950175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:00.959611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:00.960581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:00.961450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:00.964374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 296/579] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:00.972264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:00.989800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.058103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71154ef7-64f3-41cb-9db3-faf7f19fe140 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.094182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.094785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.095061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.095327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.096072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=74ff7e343a5e4aff9c4a52d1aa0332bc) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:01.096372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.098340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.105037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 284/580] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:00 2022] GET /identity/v3/role_assignments?user.id=74ff7e343a5e4aff9c4a52d1aa0332bc&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:01.105739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.106048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2cb97-b0fd-4c1b-8f93-7ee7e76847b3 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.144386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.145215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.145482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.145746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.146433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:01.146736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.148456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753df48-3932-4e2f-8974-76612d874458 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.159142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 297/581] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:01.161298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb058ca-5ef6-41e7-806c-45bfe8327864 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.161649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb058ca-5ef6-41e7-806c-45bfe8327864 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.161927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb058ca-5ef6-41e7-806c-45bfe8327864 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.163624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 298/582] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:01.172499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.172745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.173022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.186770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.194747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:01.196111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:01.236056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c47e-3c45-47a3-8a0f-28f54f1a631c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.259945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.275753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 299/583] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:01.275753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.286092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.286951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.287375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.287821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] PATH_INFO: `/v3/services/network` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.288546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.290074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:01.316018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:01.317338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:01.318194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 285/584] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:01.323023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.407760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c8c9-5c50-40a4-bd09-fb111b8e9e85 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.433762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e984897-6e05-4cd4-995d-46ff48acba7a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.467115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.468162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.468638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.469104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.483518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.486978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.488898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.498392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.499003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.499280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.499580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.500212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:01.500511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.501872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.508244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 286/585] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:01.513867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:01.522562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:01.523586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:01.524466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:01.524466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:01.524466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:01.530018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 300/586] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:01.540416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.588545 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.661075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a069-d119-4d98-9ae4-79d74b9528f6 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.679240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba16f90-d523-4f18-a3b9-e90b54bdeae2 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.699110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.699767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.700049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.700321 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.701088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] RBAC: Adding query filter params (type=network) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:01.701396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.702839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.710940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 287/587] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:01.714556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.727477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.727477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.727477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.727477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.727897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:01.727897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.727897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.741142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 301/588] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:01.742225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.796360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.828710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b3dc0-246a-4796-87df-3577c1688d68 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.840710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:01.850796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818b2ec-ec02-4449-a37b-2a6b1f3412fd None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:01.866210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.867100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.867679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.868256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.868908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.870275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:01.880640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:01.881572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:01.882387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 288/589] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:01.883145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.890168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:01.890782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.891056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.891324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.892073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] RBAC: Adding query filter params (interface=public, service_id=1b5e037df33f43c0b813609eba6ef03a, region_id=RegionOne) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:01.892368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:01.893725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db2d21-5c0f-4d80-a01b-445944593857 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:01.901646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 302/590] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/endpoints?service_id=1b5e037df33f43c0b813609eba6ef03a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:01.902876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0c26-006a-4353-bffb-c013a5db92a3 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:01.903159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0c26-006a-4353-bffb-c013a5db92a3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:01.903454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0c26-006a-4353-bffb-c013a5db92a3 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:01.904784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 303/591] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:01.905385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0c26-006a-4353-bffb-c013a5db92a3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:01.998773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3962c06-0caf-4a3c-827d-d7c500a6562c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.012718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0c26-006a-4353-bffb-c013a5db92a3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.027645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.039768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.040394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.040672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.040941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.047970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.049346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.050670 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.051850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.052127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.052667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.053281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:02.053590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.054921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.063828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 304/592] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:02.063828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-84ae3526-93bf-41ff-83f0-084e82762593 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:02.064063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:02.064895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 289/593] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:58:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.065814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.067384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.084907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:02.086077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:02.115278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.160524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 290/594] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:02.161844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.185735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0a534-224a-4e34-b11a-703fa80661ac None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.230972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.231924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.232649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.233140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.234506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.236373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.248633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 305/595] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:02.249454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.284201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635995fe-b0fe-4afc-a225-ab985661c9a9 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.300675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.336285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.337288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.337765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.338263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.339121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:02.340087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.342093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.350609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 291/596] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:02.357223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.390281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5336-306d-4f17-a6e5-18a971772f42 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.417120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.463054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.463744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.464028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.464299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.465033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:02.465338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.466784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.499532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 306/597] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:02.501899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.532796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a59874-4d04-4b59-9f17-13b06106de20 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.571334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.571976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.572287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.572533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.573353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] RBAC: Adding query filter params (interface=public, service_id=e9d2bd2bbfae457884d30922766ad6d8, region_id=RegionOne) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:02.573778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.575142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.583532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 292/598] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/endpoints?service_id=e9d2bd2bbfae457884d30922766ad6d8&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:02.584370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.621781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.629416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928a8a2-53cc-429e-80d4-56b4755c682b None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.675103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.676505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.676796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.677065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.690645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.701108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e5337-c656-48bb-b17e-4e7cf564b69c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.742606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.743615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.744171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.744644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.755698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:02.761370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:02.762261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 12:58:02.763140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:02.765661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 293/599] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:02.766630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.777559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.779025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.884487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6be0ba-6378-4604-b2b9-4968576455b8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:02.921562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:02.922554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:02.923090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:02.923623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:02.924199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:02.924664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:02.926475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:02.937172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 307/600] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 12:58:02.937172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.938965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 294/601] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:02.940792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:02.982861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:03.090481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3233f-1136-49ad-85c8-696fecdad534 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.093292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06529ed1-b0cd-4436-a862-46b14db02c65 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.163440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.163989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.164267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.164894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.167438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:03.167438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.167438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.185598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 308/602] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:03.192927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:03.199998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.200636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.200912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.201179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.224793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.226950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:03.260782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:03.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:03.262648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:03.262648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:03.262648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:03.264483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 295/603] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:03.270488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:03.300759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:03.349690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06163-3303-4d71-9e06-6a7e5ca7f714 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.375298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:03.387203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.388211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.388691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.389186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.400913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.402830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:03.437696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:03.438682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:03.439602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:03.439602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:03.439602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:03.442866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 309/604] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:03.449256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:03.475363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e0bd9-2dfd-438b-bb5a-f858e138b8dd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.545554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e625-8aae-414d-b356-668992d77edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.546561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e625-8aae-414d-b356-668992d77edf None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.547042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e625-8aae-414d-b356-668992d77edf None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.547540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e625-8aae-414d-b356-668992d77edf None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.548406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859e625-8aae-414d-b356-668992d77edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:03.548910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859e625-8aae-414d-b356-668992d77edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.550502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859e625-8aae-414d-b356-668992d77edf None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.579332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 296/605] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:03.584157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e625-8aae-414d-b356-668992d77edf None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:03.669028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5100-564b-42a6-bf68-6ca802be910e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.687885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:03.711105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.712262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.712892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.713364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.714212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:03.714714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.716372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a11c-d2c7-4c68-9176-46d7152ec3a9 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.733307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 310/606] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:03.734788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2053d3-467c-4a7f-bd2a-a80627ad4f1e None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.739534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2053d3-467c-4a7f-bd2a-a80627ad4f1e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.740032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2053d3-467c-4a7f-bd2a-a80627ad4f1e None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.741702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 311/607] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:03.742602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2053d3-467c-4a7f-bd2a-a80627ad4f1e None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:03.755632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e625-8aae-414d-b356-668992d77edf None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.783216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:03.791373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.792049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.792343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.792624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.799512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.801483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-4df192cc-9288-4b20-b1db-684f6c6c67c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:03.813294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:03.814177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:03.815052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 297/608] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:03.820570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.820867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.821143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.839817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:03.841004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:03.858903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2053d3-467c-4a7f-bd2a-a80627ad4f1e None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:03.895731 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:03.896694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:03.897196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:03.897682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:03.905613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:03.907274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:03.909565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 298/609] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:03.911088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:03.920774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:03.921692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:58:03.922622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:03.924872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 312/610] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:03.931225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.011115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.038882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480f02-b824-40bf-ac0a-a09294732c15 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.059506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3ce7-a852-409f-98b4-20378f08c080 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.076857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.077855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.078355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.079096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.080061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:04.080627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.082302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.095024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.104436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 313/611] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:04.115532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.137383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.138228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.138658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.139100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.139980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:04.140432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.142005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.158543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 299/612] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:04.165142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.273133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ccf5-8e3f-428a-b699-1d3fe8db501f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.284168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.295847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ce50-8723-4a7b-8da1-b2dafe227ae8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.308757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.309585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.310038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.310450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.311315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=62bb121942c94956b40024757f89a5c1) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:04.311796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.313392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.320501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 300/613] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/role_assignments?user.id=62bb121942c94956b40024757f89a5c1&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:04.327989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.334357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.334974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.335252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.335552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.421317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.432016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.433548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.537810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d470cc-77cb-49dc-8dfd-787834c58654 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.541884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.555237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 314/614] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:58:04.560608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.584031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.585056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.585581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.586052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.586838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.588446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:04.598385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:04.599344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:04.600246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:04.603063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 301/615] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:04.608819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.673880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9920cd-5021-4f29-82ec-7cf2db7b9198 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.710143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.710778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.711061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.711333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.721971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.723993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:04.741789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:04.742763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:04.743758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:04.743758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:04.743758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:04.743758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 315/616] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:04.752543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.787240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8638211-ba22-47ad-bd17-90ad4e4c3bbf None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.795751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.812524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:04.834408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.835958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.836596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.837963 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.839165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:04.839724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.841318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf90363-acaf-402b-aaa6-bc0b71ab6882 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.846304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 302/617] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:04.848428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18474e-1edb-4d96-b35c-3d3d00eaae03 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.849020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18474e-1edb-4d96-b35c-3d3d00eaae03 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.849512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18474e-1edb-4d96-b35c-3d3d00eaae03 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.855495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 303/618] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:04.856666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18474e-1edb-4d96-b35c-3d3d00eaae03 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:04.886285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf58f-b77f-45ad-8081-bebefaaa7c6d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.935881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:04.936736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.937016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.937286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.938790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:04.939106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:04.940506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f6d5-a3de-44d2-97bd-175064f6519f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:04.962311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 316/619] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:04.962311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:04.962311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:04.962311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:04.979104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18474e-1edb-4d96-b35c-3d3d00eaae03 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:04.982522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:04.983761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:05.015218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:05.015909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.016238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.016512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.017141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:05.017441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:05.018855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:05.031745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 304/620] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:05.032778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:05.062987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 317/621] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:05.100231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:05.172983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f810-f4a6-4acf-9d4a-b2ab65ad0e5b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:05.212168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:05.213205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.213708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.214182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.222286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:05.224181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:05.237243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:05.238213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:05.239686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:05.242260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 305/622] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:05.247767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:05.290358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:05.360445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7434c49-904e-4b41-a927-624a9d4406be None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:05.396059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:05.396664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.396941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.397207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.397891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:05.398191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:05.401416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:05.408604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:05.414430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 318/623] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:05.420579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:05.539065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:05.549003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde392-81b0-4259-a899-9ff47f605a91 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:05.590855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:05.591865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.592351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.593119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] PATH_INFO: `/v3/services/network` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.593919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:05.595567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:05.598050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:05.615912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:05.616915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:05.617720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 306/624] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:05 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:05.618493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9355-a572-48ae-9f58-500f90b6b0cc None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:05.625126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:05.697710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:05.699297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.699782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.700235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.701162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=374c419c61e34718b350e06e35764fb3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:05.701944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:05.704504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b4582-c106-446f-a041-a0fcf4a872bf None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:05.719428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 319/625] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:05 2022] GET /identity/v3/role_assignments?user.id=374c419c61e34718b350e06e35764fb3&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:05.719428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b61a4d-3d31-489c-8761-8ff271c34ac5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.719428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b61a4d-3d31-489c-8761-8ff271c34ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.719428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b61a4d-3d31-489c-8761-8ff271c34ac5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.719428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 320/626] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:05.743863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.744177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.744410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.766276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dfe6d-39fe-45c6-acf4-481a22544d0b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:05.781014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:05.782260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:05.829896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:05.832944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:05.833235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:05.833509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:05.834158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] RBAC: Adding query filter params (name=network) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:05.834456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:05.835889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:05.849490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 307/627] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:05.855384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:05.911686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:05.939592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 321/628] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:05.999391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb11c64-df0b-4e9e-9d4f-041b53e6a304 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:06.035162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:06.036071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.036500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.036915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.037738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] RBAC: Adding query filter params (type=network) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:06.038282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:06.039841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:06.045525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 308/629] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:06.050764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:06.138014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:06.153318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093674b-8d24-4f97-aecc-9d1866c198d7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:06.188138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:06.188666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.188941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.189210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.189886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:06.191240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:06.217337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 322/630] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 12:58:06.237866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:06.337574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:06.347626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949013f-b99b-47d8-9059-ebda6526bd18 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:06.390460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:06.391157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.391464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.391784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.392377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:06.393754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:06.404151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:06.405173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:06.405981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 309/631] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Oct 13 12:58:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:06.413033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:06.526189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670c17e-2c23-4485-bd69-92ce3548f1d4 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:06.561810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:06.562455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.562729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.562998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.563653 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:06.563954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:06.565340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:06.571027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 323/632] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 12:58:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:06.576464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:06.680128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b905-a316-449e-a8fc-2355f915cc1c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:06.720145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:06.721216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.721500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.721777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.724923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:06.724923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:06.724923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c70f2e-2e5c-43c3-8359-4086855b45d6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:06.729454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 310/633] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 12:58:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:06.734909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:06.744888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:06.849664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff46b-8498-4d29-ba9f-637e41c8ccdd None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:06.887285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e731a4-de33-4450-b695-ec0fc8fe16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:06.887928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e731a4-de33-4450-b695-ec0fc8fe16b4 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.888210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e731a4-de33-4450-b695-ec0fc8fe16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.888485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e731a4-de33-4450-b695-ec0fc8fe16b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.889167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e731a4-de33-4450-b695-ec0fc8fe16b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:06.890550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e731a4-de33-4450-b695-ec0fc8fe16b4 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:06.914993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 324/634] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:06.970166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971e74-eeaa-4bcf-8cbe-b7c7ca98d32c None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.970534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971e74-eeaa-4bcf-8cbe-b7c7ca98d32c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.970717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971e74-eeaa-4bcf-8cbe-b7c7ca98d32c None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:06.972475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 311/635] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:06.979077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:06.979647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:06.979647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:07.003013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:07.004322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:07.073224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:07.090595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 325/636] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:07.359354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6971e74-eeaa-4bcf-8cbe-b7c7ca98d32c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:07.372239 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:07.467980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6971e74-eeaa-4bcf-8cbe-b7c7ca98d32c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:07.503540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:07.504529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:07.504997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:07.505440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:07.506193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:07.507755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-51065ac3-773c-428d-be6c-bdd9afb41bef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:07.517568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:07.518681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:07.520181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:07.523254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 312/637] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:07.531025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:07.632161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5325b-34b1-4f4e-af56-6c042167bad1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:07.651095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6aa45-f11b-4cbc-acb6-495c43aa5de6 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:07.651746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6aa45-f11b-4cbc-acb6-495c43aa5de6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:07.652242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6aa45-f11b-4cbc-acb6-495c43aa5de6 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:07.654113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 313/638] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:07.659610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:07.660147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:07.660753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:07.667911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:07.668523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:07.668799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:07.669069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:07.669705 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:07.670042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:07.671928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:07.676382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 326/639] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:07.682092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:07.683609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:07.685153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:07.735936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:07.779657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 314/640] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:07.783871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76524-8f69-41de-ad0a-edbe77db9d1c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:07.817974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:07.818589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:07.818865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:07.819132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:07.819781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:07.820081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:07.821434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ea43b-10b8-49dd-92d3-b28d9296e2d7 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:07.826408 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 327/641] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:08.046363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:08.049987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:08.152979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bf92-35de-4a66-8417-a5e5db48330c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:08.189190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190aa4-97ee-430a-bf13-a4bb02702cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:08.190179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190aa4-97ee-430a-bf13-a4bb02702cc0 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:08.190690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190aa4-97ee-430a-bf13-a4bb02702cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:08.191171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190aa4-97ee-430a-bf13-a4bb02702cc0 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:08.192629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190aa4-97ee-430a-bf13-a4bb02702cc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:08.194228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190aa4-97ee-430a-bf13-a4bb02702cc0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:08.210655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 315/642] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:08 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:08.335661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ffd00-436d-450e-bc03-3557f67a2e48 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:08.336207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ffd00-436d-450e-bc03-3557f67a2e48 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:08.336207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ffd00-436d-450e-bc03-3557f67a2e48 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:08.337866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 328/643] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:08.343827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:08.344473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:08.344987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:08.365794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:08.367862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:08.433366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:08.450314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 316/644] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:08 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:08.717931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ffd00-436d-450e-bc03-3557f67a2e48 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:08.826452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ffd00-436d-450e-bc03-3557f67a2e48 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:08.843008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:08.860917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:08.861551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:08.861831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:08.862104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:08.873119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:08.878171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:08.879681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:08.880511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:08.883527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 329/645] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:58:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:08.886243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:08.993626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a7c5f-13d7-44e0-80fa-dcd3f5d0d4a5 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.032120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.033174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.033660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.034151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.035055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:09.035645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.037300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f81f-a35c-4281-87a1-d6131886a81b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.047177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 317/646] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 12:58:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:09.053518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.135800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba33c9-9923-45af-9ddc-bbdbc87e7844 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.136447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba33c9-9923-45af-9ddc-bbdbc87e7844 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.136813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba33c9-9923-45af-9ddc-bbdbc87e7844 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.138501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 318/647] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:09.144121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.144399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.144891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.164593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2b917-bd2d-4f27-904a-5c98fab8dc37 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.171095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:09.173166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:09.207460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.208343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.208623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.208895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.221867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.223864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.236465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:09.244182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:09.245127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:09.246661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:09.246661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:09.246661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:09.246661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 330/648] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:09.251284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.267715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 319/649] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:09 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:09.288919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:09.361345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab2dcb-7482-4eec-87df-877f97da75ed None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.395330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.395968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.396244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.396546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.397175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:09.397471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.398936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.410841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 331/650] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:09.416991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.525295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f022d-0d78-45b6-9184-e1a0c03746f3 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.530821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.569076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.569708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.569987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.570257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.580506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.582669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:09.597367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:09.598366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:09.599586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 320/651] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:09.604837 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.636928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:09.652845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:09.658190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb79d4-344f-4336-936f-b09a530a4c20 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.704736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.705955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.706392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.707636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.708782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.710815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.720188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11a5f-e595-45bd-8ffa-c6612b2c5951 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:09.722216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:09.723458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:09.724454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:09.726898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 332/652] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:09.733232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.767998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.768676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.769189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.769378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.770609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:09.770941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.772640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.796438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 321/653] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:09.797379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.854813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef34e2-85ba-4f2d-b23d-160f1b248eaf None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.889175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.889784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.890065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.890338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.890967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:09.891268 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.892711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:09.902633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 333/654] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:09.903624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:09.921995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:09.922185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:09.926783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ae57-aab0-4b04-a666-40387b0ba729 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:09.970718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:09.972178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:09.972759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:09.973176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:09.986637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:09.988991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:10.013697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:10.014669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:10.015607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:10.015607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:10.015607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:10.021813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 322/655] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:10.022503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:10.025600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6bbac-8585-4520-9eea-76c5dbb4f927 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:10.070050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:10.071066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.071726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.072017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.072664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:10.073028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:10.074465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d012-092f-457e-9ab0-c7b578654b8a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.085446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 334/656] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:10.105920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b806098-c752-4f54-9ae1-7ffc8c466e1a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.105920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b806098-c752-4f54-9ae1-7ffc8c466e1a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.106215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b806098-c752-4f54-9ae1-7ffc8c466e1a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.107951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 335/657] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:58:10.114477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.115394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.115394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.135610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:10.136856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:10.138738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4477d-2803-4078-9015-34f74d20b59f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:10.188094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:10.189332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.189802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.190259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.191908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:10.192434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:10.194563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.217402 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 323/658] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:10.218850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:10.220359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 336/659] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:10.237256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:10.327436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3118914-f585-46dd-b129-84255acc45bd None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:10.367386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:10.368059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.368339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.368680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.375997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:10.377445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-d44512b5-6d93-4b41-9e53-b271e4d45503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:10.388964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:10.389848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:10.390703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 324/660] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:10.400490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:10.413352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:10.458426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46968-9b98-4f72-9d48-8ec3240f07bd None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.458938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46968-9b98-4f72-9d48-8ec3240f07bd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.459012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46968-9b98-4f72-9d48-8ec3240f07bd None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.464194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 325/661] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:10.465657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.465943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.466220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.484725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:10.485921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:10.511037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c761354-4e31-421d-a631-020fc93660f8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:10.547550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:10.548257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.548536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.548811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.549500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:10.550056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:10.551340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.557597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 326/662] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:10.558259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:10.563702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:10.566226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 337/663] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:10.572083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:10.674506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:10.675740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb177a-d839-46dd-b27b-c62834d4030c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:10.716878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:10.717603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.717941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.718218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.718875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:10.719530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b117-519c-4ab6-ba92-4bc56d9390d1 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:10.720284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.740798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 327/664] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:10 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:10.769342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:10.770645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:10.770929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:10.771255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/374c419c61e34718b350e06e35764fb3/roles/683e402183854436a35a3b42a4f3fa50` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:10.773654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=374c419c61e34718b350e06e35764fb3, role_id=683e402183854436a35a3b42a4f3fa50)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:10.775313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:10.792649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 338/665] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:58:10 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/374c419c61e34718b350e06e35764fb3/roles/683e402183854436a35a3b42a4f3fa50 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:58:10.843067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:10.920181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:10.971382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb70dad-05b0-4a9f-b629-92d3700249b0 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:11.009608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:11.010247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:11.010523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:11.010794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:11.011377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:11.012839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:11.022008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:11.022959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:11.023883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 328/666] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 12:58:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:11.031626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:11.139010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d19cc-62c5-4162-98d7-0e48823a5e4d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:11.165697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:11.175101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:11.176597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:11.177426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:11.177971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:11.178664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:11.179005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:11.180402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:11.186340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 339/667] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:11.192269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:11.293679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481692-2dd6-4da4-8490-78ef9fc0e470 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:11.321401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:11.331115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:11.332061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:11.332556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:11.333045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:11.333902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:11.334416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:11.336010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:11.341435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 329/668] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:11.347363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:11.457834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851275-5d4e-4b80-9b74-d35ba942ec0c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:11.491962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:11.492576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:11.492858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:11.493166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:11.493833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] RBAC: Adding query filter params (interface=public, service_id=e10a288443564c1cb7a44f3d430c9581, region_id=RegionOne) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:11.494141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:11.495529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3c221-54a5-4704-ac89-f4564ce8706c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:11.501151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 340/669] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:11 2022] GET /identity/v3/endpoints?service_id=e10a288443564c1cb7a44f3d430c9581&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:11.507070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:11.610503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df477585-ce4e-436b-b7cc-f69ba1495bb4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:11.646173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894c03-2873-43c9-b595-d1e100252d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:11.647169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894c03-2873-43c9-b595-d1e100252d1c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:11.647727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894c03-2873-43c9-b595-d1e100252d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:11.648193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894c03-2873-43c9-b595-d1e100252d1c None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:11.648983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894c03-2873-43c9-b595-d1e100252d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:11.650551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894c03-2873-43c9-b595-d1e100252d1c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:11.656740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 330/670] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:11 2022] GET /identity/v3/services => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 12:58:12.352134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d48b5-cc33-4776-ae3e-738f27ae8665 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:12.352536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d48b5-cc33-4776-ae3e-738f27ae8665 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:12.352738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d48b5-cc33-4776-ae3e-738f27ae8665 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:12.354316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 341/671] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:12.359617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a293c-07bc-4187-8260-ac3bcabfd843 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:12.359908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a293c-07bc-4187-8260-ac3bcabfd843 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:12.360184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a293c-07bc-4187-8260-ac3bcabfd843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:12.378947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-eb6a293c-07bc-4187-8260-ac3bcabfd843 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:12.380194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-eb6a293c-07bc-4187-8260-ac3bcabfd843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:12.440293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:12.453573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 331/672] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:12 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:12.721654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d48b5-cc33-4776-ae3e-738f27ae8665 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:12.782328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:12.829797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d48b5-cc33-4776-ae3e-738f27ae8665 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:12.865899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aa321-a62e-4cf2-8b46-15f918ea9afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:12.866877 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa321-a62e-4cf2-8b46-15f918ea9afa None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:12.867361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa321-a62e-4cf2-8b46-15f918ea9afa None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:12.867919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa321-a62e-4cf2-8b46-15f918ea9afa None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:12.868816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aa321-a62e-4cf2-8b46-15f918ea9afa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:12.870378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aa321-a62e-4cf2-8b46-15f918ea9afa None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:12.895573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 342/673] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:12 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:13.011557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee05b1-69e1-41a6-a184-6f0b3ee41f0f None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.012071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee05b1-69e1-41a6-a184-6f0b3ee41f0f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.012071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee05b1-69e1-41a6-a184-6f0b3ee41f0f None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.013655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 332/674] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:13.019247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.020139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.020422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.031257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d6eb-9a5a-4a98-baf5-23091720a7f3 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.031613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d6eb-9a5a-4a98-baf5-23091720a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.031852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d6eb-9a5a-4a98-baf5-23091720a7f3 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.033492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 333/675] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:58:13.040497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.040782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.041063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.041159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:13.042357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:13.061898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:13.063469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:13.136210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 343/676] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:13.152903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 334/677] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:13.410115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.421532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.460183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:13.522069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f923-1216-4e59-bf48-cc30c0f1f623 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:13.524039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4dbc5-32bc-46ec-8773-97bb80831f64 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:13.538538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:13.560428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:13.561057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.561337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.561621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.562190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:13.562438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:13.563287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.563585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:13.564092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.564617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:13.574442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:13.575503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:13.576371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 335/678] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:13.582361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:13.584326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:13.585968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:13.586891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:13.587851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 344/679] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:13.593405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.693048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765d25-0d67-432e-80cb-66ec4a13421a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:13.698715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099eee0-24eb-416d-824d-e0ff72a7495b None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:13.709023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:13.737931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:13.739276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.739395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:13.740158 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.740290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.740612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.740858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.741794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:13.741905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:13.742283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:13.742465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:13.743870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:13.744171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:13.754394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 336/681] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:13.755477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.757645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 345/681] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:13.758719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.804289 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:13.866298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5260a8-3b61-46ab-910c-2364f1f0e808 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:13.877496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1cfe9-803f-47d2-815d-a958288960a6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:13.900971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:13.901581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.901860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.902132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.902760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:13.903061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:13.904458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798340-4f6a-4e33-942f-0f52190b813c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:13.911111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 337/682] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:13.913854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:13.914715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.915186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.915702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.916924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021a4d-d94e-40b1-9922-4a5f768784a4 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.917207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021a4d-d94e-40b1-9922-4a5f768784a4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.917481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021a4d-d94e-40b1-9922-4a5f768784a4 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.918872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 338/683] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:13.919431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021a4d-d94e-40b1-9922-4a5f768784a4 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:13.931373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:13.932827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-1915f6c6-0934-427a-99e6-6116d3e90f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:13.947228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:13.948376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:13.949446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:13.949446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:13.949446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:13.949446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 346/684] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:13.949446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:13.949794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:13.949881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:13.967693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:13.968869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:13.978585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.036913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021a4d-d94e-40b1-9922-4a5f768784a4 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.040823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 347/685] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:14.043954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.045074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.084099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.085097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.085582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.086051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.086940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] RBAC: Adding query filter params (interface=public, service_id=db615d75883e4bddb6ca41a17b96a77c, region_id=RegionOne) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:14.087560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.090119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.097302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 339/686] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:13 2022] GET /identity/v3/endpoints?service_id=db615d75883e4bddb6ca41a17b96a77c&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:14.104348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.152280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b017-0d55-4f7b-9bf9-ae9a1a056de4 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.189356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.190319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.190807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.191277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.192197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:14.192717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.194294 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.206056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9d8d-7852-41b5-9ba5-8ff30dd0b080 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.206891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 348/687] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:14.212516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.224649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.251761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.252701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.253158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.253605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.254432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.256049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.267799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 340/688] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 12:58:14.336646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e8b65-b8c2-406a-a39d-75b1d8160f20 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.360476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.373966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.374615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.374890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.375166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.384465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.385908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:14.398980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:14.400032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:14.400944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 349/689] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:14.406568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.408875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.480818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.488560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774d90-1049-4797-a1c5-c71476511717 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.526057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcdd62-c89b-4842-b17f-c27c89385648 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.528111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.528745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.529031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.530106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.530695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.532085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:14.543793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:14.544875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:14.545745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 341/690] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:14.550541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.574780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.576132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.576671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.577272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.579001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:14.579553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.581930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.605254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 350/691] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:14.611454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.675147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.681784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517bbc-ca8f-4e9f-83c0-5970c96b2378 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.720088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.720903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.721014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.721247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.725277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:14.725277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.725277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.736681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 342/692] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:14.737495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.752228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192888-156a-4d70-99d4-1ba0da521726 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.783784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:14.801498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.802096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.802372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.802892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.862297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa5f14-592c-49b8-bb10-eb539f197549 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:14.885641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.887537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.906718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:14.907655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:14.908304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:14.908785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:14.909933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:14.910450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:14.912504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:14.923671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 343/693] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:14.924391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:14.961608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.014706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 351/694] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 12:58:15.021553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.048144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.057854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdcdbe-d782-4bd7-911b-aebe92e5a089 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.101537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3c926-f222-4600-83d6-41b8783cb528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.102302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3c926-f222-4600-83d6-41b8783cb528 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.102704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3c926-f222-4600-83d6-41b8783cb528 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.103072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3c926-f222-4600-83d6-41b8783cb528 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.103892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3c926-f222-4600-83d6-41b8783cb528 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.105481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3c926-f222-4600-83d6-41b8783cb528 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.130780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 344/695] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:15.132550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4719c-cd83-4faf-8234-4b862839a515 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.132989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4719c-cd83-4faf-8234-4b862839a515 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.133448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4719c-cd83-4faf-8234-4b862839a515 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.135373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 345/696] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:15.144165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.144656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.145049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.145359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662019a-10d3-4632-9aee-e3a38bc1c8de None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.171722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:15.173408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:15.203032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.203907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.204516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.204892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.221721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.224089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:15.245076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:15.246264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:15.247328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:15.247328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:15.247328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:15.248790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 352/697] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:15.254202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.271798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 346/698] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:15.331900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.365169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb91a4-706f-43eb-bfc6-95e59217dcb6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.399085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.400051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.400534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.401029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.401860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:15.402358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.403961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.416940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 353/699] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:15.423167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.439204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.527778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8a06-def4-40fc-9ae1-5b31ce56ba83 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.545051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.570170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.570806 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.571085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.571381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.580430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.583225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:15.597033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:15.598537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:15.599899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 347/700] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:15.604717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.654915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b262ee-a25e-4ac0-b151-5c687fa031cb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.675811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.685997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.693317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.694317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.694701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.695065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.696009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.697371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:15.706778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:15.708601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:15.709461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:15.714407 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 354/701] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:15.715353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.720557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0608142-a438-4776-911b-f9a53ccab362 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.761163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.761933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.762314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.762971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.763621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:15.764027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.765665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.783622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 348/702] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:15.784669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.823789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9b2b-3850-406b-9cf8-9964abb102a8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.859496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.860492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.860968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.861394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.862156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:15.862596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.864142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.873953 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 355/703] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:15.875031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:15.890297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872758f-9967-4ad1-a519-3fb6c792e8f3 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:15.923832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.929363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:15.930220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:15.930737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:15.931371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:15.932361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] RBAC: Adding query filter params (role.id=683e402183854436a35a3b42a4f3fa50, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=374c419c61e34718b350e06e35764fb3) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:15.932881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:15.934815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:15.936890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:15.950658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 349/704] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/role_assignments?user.id=374c419c61e34718b350e06e35764fb3&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=683e402183854436a35a3b42a4f3fa50 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:15.985383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e27bfe-495b-4a21-ba1e-05d9f92bdb35 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:16.023599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:16.024220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:16.024496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:16.024764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:16.025403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:16.025702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:16.027099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:16.033187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 356/705] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:16.039226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:16.153713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36ba17-8d58-4940-8bb0-f6abfcb50091 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:16.188393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:16.188998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:16.189276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:16.189543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:16.190263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] RBAC: Adding query filter params (interface=public, service_id=cebf3739fb0544ebb430de8ecbc02fc3, region_id=RegionOne) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:16.190570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:16.192496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231477-d3ae-4263-8886-b418a136e490 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:16.197948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 350/706] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:16 2022] GET /identity/v3/endpoints?service_id=cebf3739fb0544ebb430de8ecbc02fc3&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:16.205169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:16.317768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a48b26-1e62-406c-b072-9f217e1758eb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:16.342381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:16.352845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f77e4-65bc-4d25-a985-16733d880b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:16.353453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f77e4-65bc-4d25-a985-16733d880b87 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:16.353730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f77e4-65bc-4d25-a985-16733d880b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:16.353999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f77e4-65bc-4d25-a985-16733d880b87 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:16.354599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f77e4-65bc-4d25-a985-16733d880b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:16.356028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f77e4-65bc-4d25-a985-16733d880b87 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:16.362626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 357/707] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:16 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 12:58:16.526179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d625c68-0117-41de-a777-b146af4c4f46 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:16.526575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d625c68-0117-41de-a777-b146af4c4f46 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:16.526754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d625c68-0117-41de-a777-b146af4c4f46 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:16.528405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 351/708] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:16.534167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:16.534456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:16.534745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:16.555125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:16.556371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:16.625336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 358/709] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:16.895186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d625c68-0117-41de-a777-b146af4c4f46 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:16.961673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:17.007610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d625c68-0117-41de-a777-b146af4c4f46 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:17.042681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:17.043360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.043688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.044010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.044595 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:17.045961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:17.055180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:17.056178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:17.056993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:17.059554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 352/710] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:17.062793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:17.165813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08afe6-35f3-407d-8bce-95d97119275d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:17.183972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:17.201481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:17.202096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.202419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.202701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.203335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:17.203662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:17.205037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b8794-f35f-49f5-aa25-dec6293ab49d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:17.215161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 359/711] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:17.217540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:17.330093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7082-b187-4818-91bf-3b541e1f65fa None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:17.354800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf3a7-2295-44a8-9fe8-6274bf0f80a8 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.354800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf3a7-2295-44a8-9fe8-6274bf0f80a8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.355102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bf3a7-2295-44a8-9fe8-6274bf0f80a8 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.356677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 360/712] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:17.361709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.361904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.362146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.366703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:17.371311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:17.372196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.372701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.373169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.373997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:17.374491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:17.376071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:17.381976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 353/713] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:17.382513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:17.391189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:17.391320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:17.467796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 361/714] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:17.505248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007d6a-2e96-4472-826c-c62e822bf10c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:17.538971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:17.539962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.540485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.540950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.541900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:17.543473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:17.564256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 354/715] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:17.734081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:17.837962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8befe-ee9f-4144-8300-eed49ad4629b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:17.849005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:17.880674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:17.881308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:17.881591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:17.881915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:17.882502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:17.883906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:17.892899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:17.893860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:17.894694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 362/716] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:17.900163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:17.948420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:18.006035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3502e7f-2fe5-4e0b-a240-aef177a828df None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:18.040089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:18.041087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.041564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.042029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.042846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:18.043341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:18.044935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedfd98-9a71-4d5e-91d8-290f7cd20722 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:18.050215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 355/717] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:18.056372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:18.170672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db532-5408-4675-837a-b1120b547bd1 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:18.204975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:18.205582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.205859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.206126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.206752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:18.207655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:18.209023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf0ce-6f55-4012-aaca-9d58b06c3c1c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:18.213961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 363/718] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:18.246152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba0117-b2aa-4974-b26c-b8d93be0e55e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.247149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba0117-b2aa-4974-b26c-b8d93be0e55e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.247665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba0117-b2aa-4974-b26c-b8d93be0e55e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.249606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 356/719] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:18.255662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b2eb-a4aa-4320-96fa-13d6c5dae20a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.255956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b2eb-a4aa-4320-96fa-13d6c5dae20a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.256277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b2eb-a4aa-4320-96fa-13d6c5dae20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.276238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e0b6b2eb-a4aa-4320-96fa-13d6c5dae20a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:18.277472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e0b6b2eb-a4aa-4320-96fa-13d6c5dae20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:18.308005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:18.354506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 364/720] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:18.626138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba0117-b2aa-4974-b26c-b8d93be0e55e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:18.692649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe9214-5a0d-4c26-9563-91e1652ff186 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.692972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe9214-5a0d-4c26-9563-91e1652ff186 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.693190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe9214-5a0d-4c26-9563-91e1652ff186 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.694858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 365/721] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:18.700452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.700838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.701212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.719188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:18.720570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:18.734771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba0117-b2aa-4974-b26c-b8d93be0e55e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:18.744615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:18.771672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:18.772294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.772571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.772842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] PATH_INFO: `/v3/services/image` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.773419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:18.774987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:18.784515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:18.785592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:18.786427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 357/722] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Oct 13 12:58:18 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:18.791921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:18.799595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 366/723] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:18.893395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028eba-cacd-4383-9473-b4eea9e15b55 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:18.928936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:18.929593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:18.929874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:18.930142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:18.930765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] RBAC: Adding query filter params (name=image) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:18.931061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:18.932540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:18.937704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 358/724] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:18.944860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:19.042138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:19.049174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16389d-a092-4151-aa3c-d14ccbc44657 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:19.083517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:19.084130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.084404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.084679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.085300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] RBAC: Adding query filter params (type=image) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:19.085596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:19.087038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:19.087715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:19.092187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 367/725] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:19.129597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:19.201963 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5639-e2e7-44ed-83cf-30c7f0883918 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:19.241177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:19.241821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.242096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.242367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.242954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:19.244376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:19.254097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:19.256920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:19.258902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 359/726] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:19.263436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:19.365845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4d60-dda0-44d1-bcf2-be33c20b1ffe None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:19.399660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:19.400271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.400550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.400820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.401441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:19.401739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:19.403140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:19.408119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 368/727] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:19.414451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:19.518655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:19.522016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df6fa-c3d9-4a22-a297-b1c00ae75652 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:19.561317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:19.562162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.562584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.563018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.563824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:19.564261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:19.565774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f225c-2e40-49f4-bb55-942f5fe1fe11 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:19.571307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 360/728] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 12:58:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:19.576592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:19.603901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:19.680766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdb267-5472-4af0-a135-f99d767b2db2 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:19.714484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37217-7adf-44b3-b976-00beec759965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:19.715080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37217-7adf-44b3-b976-00beec759965 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.715358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37217-7adf-44b3-b976-00beec759965 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.715657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37217-7adf-44b3-b976-00beec759965 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.716333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37217-7adf-44b3-b976-00beec759965 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:19.717703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37217-7adf-44b3-b976-00beec759965 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:19.741288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 369/729] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:19.940093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92784-066d-42a1-ba98-96628c38cf2e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.940460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92784-066d-42a1-ba98-96628c38cf2e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.940638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92784-066d-42a1-ba98-96628c38cf2e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.942644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 361/730] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:19.948220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec785d2-b142-46fb-9d3a-02268b9c1240 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:19.948781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec785d2-b142-46fb-9d3a-02268b9c1240 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:19.949251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec785d2-b142-46fb-9d3a-02268b9c1240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:19.968507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6ec785d2-b142-46fb-9d3a-02268b9c1240 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:19.970030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6ec785d2-b142-46fb-9d3a-02268b9c1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:20.047336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 370/731] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:20.320835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92784-066d-42a1-ba98-96628c38cf2e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:20.429748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92784-066d-42a1-ba98-96628c38cf2e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:20.437070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fb666-b800-4b21-bc01-8ea0d82a0b16 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:20.437689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fb666-b800-4b21-bc01-8ea0d82a0b16 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:20.437689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fb666-b800-4b21-bc01-8ea0d82a0b16 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:20.439082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 371/732] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:20.447456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:20.447456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:20.447456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:20.452905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:20.464097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:20.465825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:20.466588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:20.467461 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:20.467897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:20.468310 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:20.469041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:20.470535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:20.480172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:20.481368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:20.482357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:20.484724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 362/733] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:20.491131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:20.520893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:20.551514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 372/734] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:20.594224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e780-1068-4fc7-a75f-d3a960b49df9 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:20.627976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:20.629299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:20.629784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:20.630220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:20.630979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:20.631531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:20.633191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:20.638268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 363/735] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:20.644044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:20.746043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9fde4-9214-443a-abb7-3f6065ec1859 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:20.780443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:20.781043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:20.781321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:20.781592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:20.782213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:20.782510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:20.783910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:20.789018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 373/736] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:20.789453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:20.799429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:20.841216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:20.893404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:20.903348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e62a8-94c0-42c3-ab9a-dd8b119bf3a6 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:20.939685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:20.940286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:20.940563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:20.940830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:20.942164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] RBAC: Adding query filter params (interface=admin, service_id=db615d75883e4bddb6ca41a17b96a77c, region_id=RegionOne) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:20.942466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:20.944454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:20.959041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 364/737] 10.222.0.25 () {56 vars in 1249 bytes} [Thu Oct 13 12:58:20 2022] GET /identity/v3/endpoints?service_id=db615d75883e4bddb6ca41a17b96a77c&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:20.961297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:20.964332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1e681-5d27-4689-8740-9df830563b5d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:21.010744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe565a-2eb6-48e7-afb7-7e45a23c7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:21.011346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe565a-2eb6-48e7-afb7-7e45a23c7969 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:21.011651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe565a-2eb6-48e7-afb7-7e45a23c7969 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:21.011919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe565a-2eb6-48e7-afb7-7e45a23c7969 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:21.012568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe565a-2eb6-48e7-afb7-7e45a23c7969 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:21.013933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe565a-2eb6-48e7-afb7-7e45a23c7969 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:21.035107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 374/738] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:20 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:21.091890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23a59-6759-48c6-9d29-c0fe11d18464 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:21.139815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584fe8-46b0-4fbb-ad00-57ede213a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:21.140715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584fe8-46b0-4fbb-ad00-57ede213a434 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:21.141149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584fe8-46b0-4fbb-ad00-57ede213a434 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:21.141613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584fe8-46b0-4fbb-ad00-57ede213a434 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:21.142380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584fe8-46b0-4fbb-ad00-57ede213a434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:21.144176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584fe8-46b0-4fbb-ad00-57ede213a434 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:21.152642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 365/739] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:20 2022] GET /identity/v3/services => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 12:58:21.334128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239dc3-8f01-4bfc-a94a-d10f1fbd36d5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:21.334411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239dc3-8f01-4bfc-a94a-d10f1fbd36d5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:21.334696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239dc3-8f01-4bfc-a94a-d10f1fbd36d5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:21.336317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 375/740] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:21.341670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07397ef-99d4-4026-b6a0-5bdcbb3caff2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:21.342111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07397ef-99d4-4026-b6a0-5bdcbb3caff2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:21.342277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07397ef-99d4-4026-b6a0-5bdcbb3caff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:21.360668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e07397ef-99d4-4026-b6a0-5bdcbb3caff2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:21.361853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e07397ef-99d4-4026-b6a0-5bdcbb3caff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:21.373079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:21.433012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 366/741] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:21.705475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239dc3-8f01-4bfc-a94a-d10f1fbd36d5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:21.779013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:21.823465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239dc3-8f01-4bfc-a94a-d10f1fbd36d5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:21.857514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d4d61-01b6-43d7-b617-99b75d584026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:21.858126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4d61-01b6-43d7-b617-99b75d584026 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:21.858399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4d61-01b6-43d7-b617-99b75d584026 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:21.858666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4d61-01b6-43d7-b617-99b75d584026 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:21.859330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d4d61-01b6-43d7-b617-99b75d584026 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:21.860718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d4d61-01b6-43d7-b617-99b75d584026 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:21.880477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 376/742] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:21 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:22.061379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd6cfb-74da-484a-ba95-a393f9f2bac2 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:22.061732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd6cfb-74da-484a-ba95-a393f9f2bac2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:22.061915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd6cfb-74da-484a-ba95-a393f9f2bac2 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:22.063578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 367/743] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:22.068874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:22.069163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:22.069440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:22.089622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:22.090873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:22.167438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 377/744] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:22.436288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd6cfb-74da-484a-ba95-a393f9f2bac2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:22.544111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd6cfb-74da-484a-ba95-a393f9f2bac2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:22.579071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:22.579703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:22.579979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:22.580246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:22.580895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:22.582350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:22.585011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING keystone.server.flask.common [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 13 12:58:22.603143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.sql.core [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 12:58:22.603143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 12:58:22.603143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [parameters: {'id': '0d41806cf772449ba6b313efe88907dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 12:58:22.603143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81580) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d41806cf772449ba6b313efe88907dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d41806cf772449ba6b313efe88907dc. Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:58:22.610796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result.read() Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 12:58:22.611584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application yield resource Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise self.value Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application session.commit() Oct 13 12:58:22.612934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.session.flush() Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application compat.raise_( Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 12:58:22.614405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 12:58:22.615282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result.read() Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:58:22.616095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [parameters: {'id': '0d41806cf772449ba6b313efe88907dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:22.618054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:22.619901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d41806cf772449ba6b313efe88907dc. Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:22.621964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 368/745] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Oct 13 12:58:22 2022] POST /identity/v3/projects => generated 262 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:22.631508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:22.677336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:22.735150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acef2f-b2aa-4927-bef2-8e0081146bbc None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:22.770314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:22.770983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:22.771267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:22.771567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:22.778437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:22.780057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-c5dfd450-7b1f-4ac4-ab94-14310f84963d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:22.791836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:22.792707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:22.793582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:22.797718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 378/746] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:22.799347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:22.803332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:22.908740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da051-3c1b-4430-ac7a-8b453fba8397 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:22.943812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:22.944422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:22.944699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:22.944967 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:22.945621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:22.945920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:22.947569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9bae1-023c-4453-95e2-8d4d48ece3a7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:22.971555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 369/747] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:23.258889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cc21b-e19a-4f03-b7c6-8f8edda6311a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:23.259240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cc21b-e19a-4f03-b7c6-8f8edda6311a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:23.259494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cc21b-e19a-4f03-b7c6-8f8edda6311a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:23.261254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 379/748] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:23.267188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af859-b6af-49e4-8996-a9d94a4924f7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:23.267587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af859-b6af-49e4-8996-a9d94a4924f7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:23.267756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af859-b6af-49e4-8996-a9d94a4924f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:23.289434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-386af859-b6af-49e4-8996-a9d94a4924f7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:23.291003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-386af859-b6af-49e4-8996-a9d94a4924f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:23.351745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:23.363071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 370/749] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:23 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:23.386978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763c98-d0dc-4320-b5e8-088f1c25d669 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:23.387271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763c98-d0dc-4320-b5e8-088f1c25d669 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:23.387582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763c98-d0dc-4320-b5e8-088f1c25d669 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:23.389257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 380/750] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:23.395056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:23.395501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:23.395787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:23.414526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:23.416134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:23.485972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 371/751] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:23 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:23.635368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b763c98-d0dc-4320-b5e8-088f1c25d669 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:23.759234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:23.857310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b763c98-d0dc-4320-b5e8-088f1c25d669 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:23.860469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:23.884537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac191a3-7904-429e-8384-d651355a3007 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:23.896787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:23.897890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:23.897890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:23.897890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:23.898460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:23.899945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:23.909378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:23.910958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:23.916315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 381/752] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:23.919191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:23.932569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:23.942891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:23.943564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:23.943849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:23.944126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:23.944721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:23.946113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:23.957754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:23.958735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 12:58:23.959588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:23.961010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 372/753] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 12:58:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:23.965187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.038219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbd56-caf0-4da3-92e1-e8fa03756352 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.075781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.077103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.077625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.077914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.078549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:24.078845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.080233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.080392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366d00-7e6b-4ea9-8dc6-5cf338e2fdf2 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.091023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 382/754] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:24.091947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.120028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.120637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.121146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.121648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.122861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:24.123528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.125649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.126504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:24.137842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 373/755] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:24.139080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.199246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:24.220242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7769c-4a0b-4080-95da-48a92c857347 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.258843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.259050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec0804-ec68-4c53-bb96-34b9e8c05517 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.259487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.259768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.260041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.260675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:24.261014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.262461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39fb9-5d37-45c0-a825-a4707f5d4384 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.268357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 383/756] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:24.270154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8d41-b8e8-44f1-88dd-3429a6c7496d None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.270440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8d41-b8e8-44f1-88dd-3429a6c7496d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.270711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8d41-b8e8-44f1-88dd-3429a6c7496d None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.272197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 384/757] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:24.274698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf8d41-b8e8-44f1-88dd-3429a6c7496d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.300496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.301249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.301522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.301797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.302440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:24.303024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.304399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f32d0a-b524-4157-98b5-1df86cced9af None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.311459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 374/758] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 12:58:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:24.311459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.311459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.311459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.331926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:24.334678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:24.381597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:24.389919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf8d41-b8e8-44f1-88dd-3429a6c7496d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.411612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 375/759] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:24 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:24.416466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.428879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.429668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.430234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.430728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.431607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] RBAC: Adding query filter params (interface=public, service_id=37f522c868094fa186415a9df7d7b81d, region_id=RegionOne) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:24.431975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.433520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.439673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 385/760] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:24 2022] GET /identity/v3/endpoints?service_id=37f522c868094fa186415a9df7d7b81d&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:24.448534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.481624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:24.542873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d347c-c298-4ab6-b90b-ffb8c92611d9 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.555649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd4853-8eb2-444b-b76a-b03e0a043ec3 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.581393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.582575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.582857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.583124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.583826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.585439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.595336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.596132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.596515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.596799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.597484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.598990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.611429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 386/761] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:24 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 12:58:24.611651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 376/762] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:24.721860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:24.755041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:24.842066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513570c-701a-4f5a-87e1-4f2659bc7652 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:24.885963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:24.886582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:24.886858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:24.887129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] PATH_INFO: `/v3/services/image` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:24.887734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:24.889169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:24.898767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:24.899878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:24.900717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 387/763] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Oct 13 12:58:24 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:24.905873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:25.010965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31787684-a18c-4050-950a-d3740da9f4f0 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:25.013776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:25.047911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:25.048520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.048801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.049074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.049714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] RBAC: Adding query filter params (name=image) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:25.050015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:25.051426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:25.057060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 377/764] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:25.064779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:25.160242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:25.177042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46f3ef-d294-434b-a9bc-0fd13aa95238 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:25.213265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:25.213885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.214172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.214445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.215076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] RBAC: Adding query filter params (type=image) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:25.215379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:25.216767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835904-c001-4e83-a46b-be2b28d8fb92 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:25.222162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 388/765] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:25.228515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:25.234062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812baf2-44da-40ca-b9c9-129e89cb1dd2 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.234357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812baf2-44da-40ca-b9c9-129e89cb1dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.234610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812baf2-44da-40ca-b9c9-129e89cb1dd2 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.236104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 389/766] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:58:25.241800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.242078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.242346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.263207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:25.265011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:25.347181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c3d93-9e71-477f-838f-79786cb2a33c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:25.365985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 390/767] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:25.389415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:25.390024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.390302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.390579 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.391337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] RBAC: Adding query filter params (interface=public, service_id=4a68dd7c15484c578f200236a4f95ad4, region_id=RegionOne) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:25.391679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:25.393176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:25.398818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 378/768] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 12:58:25 2022] GET /identity/v3/endpoints?service_id=4a68dd7c15484c578f200236a4f95ad4&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:25.404528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:25.485591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:25.508141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295eeae-6068-43a5-a265-50d272aa6141 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:25.541920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:25.542446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.542723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.542990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.543622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:25.544977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:25.552339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 391/769] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 12:58:25 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 12:58:25.666272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:25.701540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:25.775247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d455a03-3d17-434b-b25e-793fbafc3771 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:25.811223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:25.811786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.812066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.812330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.812972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:25.814402 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:25.830174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.sql.core [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 12:58:25.830174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 12:58:25.830174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [parameters: {'user_id': '1909cfe5d6584101a7da82afa05de57b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 12:58:25.830174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81580) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result.read() Oct 13 12:58:25.837682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:58:25.838544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application yield resource Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise self.value Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application session.commit() Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 12:58:25.839495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.session.flush() Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application compat.raise_( Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 12:58:25.840379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:58:25.841264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application result.read() Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:58:25.842100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [parameters: {'user_id': '1909cfe5d6584101a7da82afa05de57b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:25.842904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 13 12:58:25.844999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:25.847162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 379/770] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 12:58:25 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:25.848197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:25.950193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36285f3-bf2a-4f6a-9674-a445f12075dc None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:25.985958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:25.986921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:25.987346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:25.987777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:25.995743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:25.997493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-f132fedb-5264-4803-8e6f-309d913088e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:26.009177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:26.010270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 12:58:26.011387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:26.018005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 392/771] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:58:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:26.020348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:26.115801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:26.122446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbb906-1bf7-410e-83e6-e30767fe1a7d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:26.157682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:26.158333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:26.158613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:26.158884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:26.159664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:26.160038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:26.162215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a20ec8-16f8-4ec0-8cb7-7f289b6bf72a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:26.203565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 380/772] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 12:58:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:26.904586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5fd73-3860-457c-8c19-12b11c760fcb None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:26.904951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5fd73-3860-457c-8c19-12b11c760fcb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:26.905144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5fd73-3860-457c-8c19-12b11c760fcb None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:26.906498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 393/773] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:26.912323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:26.912798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:26.913102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:26.931517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:26.933027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:26.946890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b95a4-5250-4c35-b850-bf81fca9acce None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:26.947181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b95a4-5250-4c35-b850-bf81fca9acce None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:26.947481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b95a4-5250-4c35-b850-bf81fca9acce None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:26.948809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 394/774] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:26.953779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:26.954311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:26.954311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:26.961035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:26.974710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:26.975931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:27.005976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 381/775] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:26 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:27.046681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 395/776] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:26 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:27.272568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:27.315337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:27.356125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:27.375682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7abb4d-db96-4052-8df4-11d540da5315 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:27.415240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:27.416072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.416257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.416496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.417176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:27.418897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:27.422382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3065396-fd53-463e-b864-2c1731c1fb55 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:27.428677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:27.429802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:27.430612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 382/777] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:27.436268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:27.456645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:27.462427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:27.463158 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.463327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.463628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.464726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:27.466153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:27.467892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 396/778] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:27.473630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:27.546279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5b33-faa8-4726-bc25-30d2cd881d68 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:27.582334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:27.582940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.583221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.583524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.584157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:27.584465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:27.585830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:27.586747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19be9-5e20-4992-a1c9-4fb3891f4a51 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:27.590976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 383/779] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:27.596565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:27.609548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:27.622783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:27.623389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.623710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.623982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.624625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:27.626048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:27.654923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 397/780] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:27 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 12:58:27.710186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8a1a8-2bce-4ad7-a6a4-d0d99b63585e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:27.756245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:27.756870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.757144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.757413 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.758050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:27.758349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:27.759764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587516e-3d1d-4a59-90f3-2dbaa22f6714 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:27.765423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 384/781] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 12:58:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:27.771709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:27.804659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d345-7d8d-495b-98bc-ea7295924de2 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.804855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d345-7d8d-495b-98bc-ea7295924de2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.805130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d345-7d8d-495b-98bc-ea7295924de2 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.806495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 385/782] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:58:27.812128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.812421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.812686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.831183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:27.833751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:27.835152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:27.888711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8385d-8a2f-4228-812f-e1b2227d6072 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:27.910760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 386/783] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:27.924787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:27.925393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:27.925694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:27.925961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:27.926729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:27.928430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:27.949887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 398/784] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:28.185030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:28.188315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:28.290216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ccc8f-cb9b-4e3e-a0fc-d16f6c5f7f6a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:28.329652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:28.330637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:28.331068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:28.331522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] PATH_INFO: `/v3/services/image` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:28.332787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:28.334376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:28.343536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:28.344708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 12:58:28.345696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:28.348632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 387/785] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Oct 13 12:58:28 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:28.354245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:28.457808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7a9c6-d1d3-4548-8330-9240016b8b7f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:28.466583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:28.494304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:28.494304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:28.494304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:28.494304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:28.494898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:28.495069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:28.496478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:28.501576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 399/786] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:28.507141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:28.570493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:28.612715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06e143-01ee-41c8-85a9-6480f00e6490 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:28.646180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:28.646785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:28.647061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:28.647328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:28.648035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:28.648334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:28.649741 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5870679-9921-4fb1-80c9-7dd319e874c3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:28.658873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 388/787] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:28.660201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:28.764897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaaa5-0f37-4fc9-8b01-7b987cf377e6 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:28.798211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49760f-21d4-4593-8568-bfe11fbeb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:28.798813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49760f-21d4-4593-8568-bfe11fbeb257 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:28.799089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49760f-21d4-4593-8568-bfe11fbeb257 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:28.799361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49760f-21d4-4593-8568-bfe11fbeb257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:28.800055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49760f-21d4-4593-8568-bfe11fbeb257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:28.801446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49760f-21d4-4593-8568-bfe11fbeb257 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:28.822022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 400/788] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 12:58:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:29.855934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd83b7-413f-4d2b-aebc-a99d67387cf4 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:29.856438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd83b7-413f-4d2b-aebc-a99d67387cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:29.856513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd83b7-413f-4d2b-aebc-a99d67387cf4 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:29.857983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 389/789] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:29.863078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd8c2-b3cb-4f8b-b7e9-dab9f127d096 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:29.863977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd8c2-b3cb-4f8b-b7e9-dab9f127d096 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:29.864192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd8c2-b3cb-4f8b-b7e9-dab9f127d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:29.882352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ccbbd8c2-b3cb-4f8b-b7e9-dab9f127d096 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:29.883561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ccbbd8c2-b3cb-4f8b-b7e9-dab9f127d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:29.906411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:29.959084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 401/790] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:30.159463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667224c-3d4e-4b80-95d4-d07aa0321924 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:30.159829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667224c-3d4e-4b80-95d4-d07aa0321924 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:30.160569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667224c-3d4e-4b80-95d4-d07aa0321924 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:30.162010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 390/791] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:30.166848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:30.167140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:30.167435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:30.185818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:30.186990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:30.234053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667224c-3d4e-4b80-95d4-d07aa0321924 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:30.253944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 402/792] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:30.336988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667224c-3d4e-4b80-95d4-d07aa0321924 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:30.362924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:30.371965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:30.372584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:30.372859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:30.373127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:30.374218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:30.375678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:30.379465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 391/793] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:30.382992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:30.468041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:30.484714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04b69-266e-4af5-98b1-f143f31da566 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:30.517751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:30.518462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:30.518741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:30.519006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:30.520993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:30.521575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:30.522988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:30.546791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 403/794] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:58:30 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 12:58:30.632278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d84c-8c75-446a-8922-7b8b8f6ddcf4 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:30.668597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:30.669245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:30.669523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:30.669792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:30.682160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:30.687149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:30.688172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:30.692403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 392/795] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:58:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:30.695011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:30.808285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fcb1-3c5f-4abb-9bbb-b459af99266a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:30.841934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:30.842541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:30.842814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:30.843082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:30.843766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:30.844066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:30.845445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6160-4c43-43a5-a537-896310e42c73 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:30.859806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 404/796] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 12:58:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:30.861296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:30.923594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:30.971839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8cba4-4bd2-4b6b-b334-fe5730a0040a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.005205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184cfa-e889-4bcd-8d2a-2c9ac6eb378d None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.005714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.005823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184cfa-e889-4bcd-8d2a-2c9ac6eb378d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.005823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184cfa-e889-4bcd-8d2a-2c9ac6eb378d None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.006147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.006262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.006530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.007143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 405/797] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:31.011930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.012212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.012481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.017467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.018570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.018914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.032665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:31.033855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:31.036080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:31.037346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:31.038221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:31.038221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:31.038221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:31.038221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 393/798] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:31.044417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.109580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 406/799] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:31.149608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbbb1-6243-46c3-9268-4897faa54009 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.158923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.184929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.185532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.185815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.186088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.186726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:31.187032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.188447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.200872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 394/800] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:31.206273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.305765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb31a-67c0-424c-95d7-5345b7e2b099 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.334732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.340661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.341689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.342356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.342625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.349667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.351130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:31.362548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:31.364012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:58:31.364931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.367730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 407/801] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:31.369885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.387334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.484732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258952d-0ed5-440a-9ac9-fb9f689528c3 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.491791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9c715-bda4-45b0-a23d-1dc875724da8 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.521686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.522293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.522572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.522849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.523608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:31.523919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.525352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.526977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.527600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.527880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.528148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.528808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.530147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.537480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.sql.core [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 12:58:31.537480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 12:58:31.537480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [parameters: {'id': '5e7d11ff855e4e4786333b8b9e802de3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 12:58:31.537480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81579) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:58:31.544900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result.read() Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 12:58:31.545722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application yield resource Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application next(self.gen) Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise self.value Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application session.commit() Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 12:58:31.546637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.session.flush() Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application compat.raise_( Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 12:58:31.547562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 12:58:31.548534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application conn.query(q) Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application result.read() Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 12:58:31.549458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [parameters: {'id': '5e7d11ff855e4e4786333b8b9e802de3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 12:58:31.550505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:31.552066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 408/802] 10.222.0.25 () {60 vars in 1137 bytes} [Thu Oct 13 12:58:31 2022] POST /identity/v3/domains => generated 190 bytes in 159 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:31.553431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.555030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 395/803] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:31.560284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.587784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.615773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.662269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b50b-c0b6-4571-a2cb-fa1700962013 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.665449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82724341-b15c-4d18-b493-802b40e80d1e None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.696516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.697144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.697423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.697694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.700271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.700899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.701180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.701450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.708455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.709899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.714139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.714139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:31.732229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:31.733155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:31.739833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:31.739833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:31.739833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:31.740052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:31.741062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:31.742706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:31.742706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:31.742706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:31.742706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 409/804] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:31.743156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 396/805] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:31.743286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.743435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.827636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.848482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f43ca-3666-4e15-8d25-6180f0d4d103 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.853399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9ede-d3c3-4879-b5d2-598973b86e3d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:31.857487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:31.884838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.885529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.885708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.885976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.886610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:31.886908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.888284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.892297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:31.893455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:31.893917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:31.894395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:31.895213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:31.895728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:31.897139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:31.900655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 410/806] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:31.906507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:31.919443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 397/807] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:32.015388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371902f6-7bf5-460a-86fc-e4ad8e0d8299 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:32.051767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:32.052461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:32.052742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:32.053279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:32.060705 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:32.062223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:32.074874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:32.075840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:32.076728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 411/808] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:32.082534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:32.184559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deb0c4-bec9-4e3c-aaee-7f368d9e0749 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:32.220176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:32.220782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:32.221079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:32.221353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:32.222040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:32.222342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:32.224455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedbd49-daa2-4ac4-9b17-1ab36f62e1d6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:32.231090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:32.239736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 398/809] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:32.242648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:32.270772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:32.339701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee446e1-f2e3-4482-a6d5-c3a5cd973ddb None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:32.371714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b880b0-dc8a-4b59-be3f-d2ddfeb1e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:32.372368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b880b0-dc8a-4b59-be3f-d2ddfeb1e7bb None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:32.372643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b880b0-dc8a-4b59-be3f-d2ddfeb1e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:32.372914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b880b0-dc8a-4b59-be3f-d2ddfeb1e7bb None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/74ff7e343a5e4aff9c4a52d1aa0332bc/roles/683e402183854436a35a3b42a4f3fa50` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:32.375049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b880b0-dc8a-4b59-be3f-d2ddfeb1e7bb None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=74ff7e343a5e4aff9c4a52d1aa0332bc, role_id=683e402183854436a35a3b42a4f3fa50)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:32.376513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b880b0-dc8a-4b59-be3f-d2ddfeb1e7bb None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:32.389785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 412/810] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:58:32 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/74ff7e343a5e4aff9c4a52d1aa0332bc/roles/683e402183854436a35a3b42a4f3fa50 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:58:32.743563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec407a-547e-434a-9450-339760ec2e01 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:32.743866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec407a-547e-434a-9450-339760ec2e01 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:32.744139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec407a-547e-434a-9450-339760ec2e01 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:32.745491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 399/811] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:32.750719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:32.751003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:32.751336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:32.769438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:32.770604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:32.834912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 413/812] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:33.102218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec407a-547e-434a-9450-339760ec2e01 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:33.202401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec407a-547e-434a-9450-339760ec2e01 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:33.236231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:33.236891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:33.237173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:33.237446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:33.249230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:33.254163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:33.255241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:33.256422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 400/813] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:33.261300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:33.279127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:33.357970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb688a-2010-4dce-a652-1f97e7d4a9f8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:33.390295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:33.390890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:33.391169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:33.391460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:33.392121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:33.392425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:33.393863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:33.401619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 414/814] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:33.407327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:33.465334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:33.621274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12bad-929d-44b5-ba5b-e3be036938ff None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:33.653235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:33.653845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:33.654119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:33.654385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] PATH_INFO: `/v3/users/6a720b8d53cc41e0990cb1c4a8fa4c27` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:33.667336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6a720b8d53cc41e0990cb1c4a8fa4c27)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:33.668792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:33.670355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 401/815] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:33 2022] GET /identity/v3/users/6a720b8d53cc41e0990cb1c4a8fa4c27 => generated 285 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:33.676187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:33.755213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:33.773906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb1bd-8675-47f4-9200-760d048c6aea None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:33.805689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd8b33-e9c3-410d-9efa-1e5f89d71a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:33.806303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd8b33-e9c3-410d-9efa-1e5f89d71a69 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:33.806575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd8b33-e9c3-410d-9efa-1e5f89d71a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:33.806843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd8b33-e9c3-410d-9efa-1e5f89d71a69 None admin] PATH_INFO: `/v3/projects/d92d3cfabc494d2ca0836562016908d7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:33.807958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd8b33-e9c3-410d-9efa-1e5f89d71a69 None admin] RBAC: Authorizing `identity:get_project(project_id=d92d3cfabc494d2ca0836562016908d7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:33.809369 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd8b33-e9c3-410d-9efa-1e5f89d71a69 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:33.810971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 415/816] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:58:33 2022] GET /identity/v3/projects/d92d3cfabc494d2ca0836562016908d7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:33.816874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:33.911388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e82eb-fc5d-4753-bb42-e9fbe6e225e7 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:33.926423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:33.944750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8df279-4e75-458d-b4e7-8ce20306574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:33.945406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8df279-4e75-458d-b4e7-8ce20306574f None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:33.945690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8df279-4e75-458d-b4e7-8ce20306574f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:33.945966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8df279-4e75-458d-b4e7-8ce20306574f None admin] PATH_INFO: `/v3/projects/d92d3cfabc494d2ca0836562016908d7/users/6a720b8d53cc41e0990cb1c4a8fa4c27/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:33.947893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8df279-4e75-458d-b4e7-8ce20306574f None admin] RBAC: Authorizing `identity:create_grant(project_id=d92d3cfabc494d2ca0836562016908d7, user_id=6a720b8d53cc41e0990cb1c4a8fa4c27, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:33.949330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8df279-4e75-458d-b4e7-8ce20306574f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:33.962363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 402/817] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:58:33 2022] PUT /identity/v3/projects/d92d3cfabc494d2ca0836562016908d7/users/6a720b8d53cc41e0990cb1c4a8fa4c27/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:58:34.501203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e544e-f7b3-451c-91a0-02bfa2162b60 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:34.501728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e544e-f7b3-451c-91a0-02bfa2162b60 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:34.501728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e544e-f7b3-451c-91a0-02bfa2162b60 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:34.503218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 416/818] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:34.508791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:34.509209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:34.509333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:34.526713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:34.527900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:34.591097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 403/819] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:34.854001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e544e-f7b3-451c-91a0-02bfa2162b60 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:34.950563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e544e-f7b3-451c-91a0-02bfa2162b60 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:34.982857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:34.983495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:34.983772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:34.984040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:34.993631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:34.998470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:34.999476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:35.000318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 417/820] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 12:58:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:35.005499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:35.103869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5823f5a-a405-4da1-90e0-1e91b711efad None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:35.110847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:35.137455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:35.138049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:35.138324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:35.138589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:35.139241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:35.139575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:35.140919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:35.149104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 404/821] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 12:58:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:35.154830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:35.166525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:35.250992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401248-cddd-4fa6-9f96-31043e1ae430 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:35.283308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:35.283942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:35.284216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:35.284483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:35.294547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:35.295999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:35.310147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:35.311038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:35.312501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:35.312501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:35.312501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:35.312501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 418/822] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:35.316940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:35.411480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda3b7d-57a9-4ed3-be79-2916efc91fce None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:35.443957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:35.444548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:35.444826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:35.445098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:35.445725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:35.446025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:35.447380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:35.458643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 405/823] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:35.464288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:35.520702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:35.559754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de9992-ad98-40cc-82a9-12c5c65c8964 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:35.592023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:35.592640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:35.592913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:35.593177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:35.600211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:35.601624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 12:58:35.612344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:35.613443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:35.614421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 419/824] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 12:58:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:35.619360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:35.648391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:35.717066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effecb-df7d-485b-b101-e250f1e0985d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:35.750218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:35.750823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:35.751103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:35.751374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:35.752174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:35.752476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:35.754454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:35.770951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 406/825] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 12:58:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:35.776620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:35.872012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68357-fb35-40e8-a2c6-afa78f287aea None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:35.891950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:35.906447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8ae9f-132b-4aaa-ba50-58f4995e382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:35.907054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8ae9f-132b-4aaa-ba50-58f4995e382e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:35.907334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8ae9f-132b-4aaa-ba50-58f4995e382e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:35.907637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8ae9f-132b-4aaa-ba50-58f4995e382e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:35.973079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8ae9f-132b-4aaa-ba50-58f4995e382e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:35.974474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8ae9f-132b-4aaa-ba50-58f4995e382e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.073200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 420/826] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:58:36.078904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.092651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ec59-44cf-4821-9c57-77c87089b849 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.092940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ec59-44cf-4821-9c57-77c87089b849 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.093213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ec59-44cf-4821-9c57-77c87089b849 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.094535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 421/827] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 12:58:36.099966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.100247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.100520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.118249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:36.119459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:36.132960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.162721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.177906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1ef1-51c5-452a-b1fe-57a8f39f917d None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.186050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 422/828] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:58:36.210119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.210742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.211024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.211297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.220904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.222332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 12:58:36.236930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:36.237845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 12:58:36.239370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 12:58:36.239370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 12:58:36.239370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:36.239370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 407/829] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:36.244298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.340578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe3bc0-08c1-49f3-aae2-b661708ed8e4 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.374354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.374945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.375225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.375529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.376163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:36.376463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.377823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.388973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 423/830] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:36.394330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.451616 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.464610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.492360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c19e8b-22eb-4e43-bacf-68dc79ba903b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.524852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.525479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.525758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.526024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.533058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.534650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.536923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 12:58:36.547375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:36.548282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:36.549193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 408/831] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:36.553861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839fad-863e-42c1-91fa-50c130043f2f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.554440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.587129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.587783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.588062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.588337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.599070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:36.603902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:36.604874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:36.606483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 424/832] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 12:58:36.610842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.651800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bed24-ee69-4a70-9de0-ad36df89c422 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.680658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.684693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.685296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.685581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.685851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.686537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:36.686843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.688296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.700219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 409/833] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:36.706185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.713903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db33f3-ecc5-4ff2-9e2f-be92c08c36ef None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.748120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.748662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.748938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.749208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.749870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:36.750170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.751560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.759916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 425/834] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:36.763973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.765811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:36.806661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4024c4b-4821-42b3-91d9-dd41a4e2c840 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.839679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.840273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.840558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.840828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.841546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] RBAC: Adding query filter params (role.id=683e402183854436a35a3b42a4f3fa50, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=74ff7e343a5e4aff9c4a52d1aa0332bc) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:36.841861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.843282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.849863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 410/835] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/role_assignments?user.id=74ff7e343a5e4aff9c4a52d1aa0332bc&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=683e402183854436a35a3b42a4f3fa50 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:36.863201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed3f0-4328-4fe5-9778-93968f352b20 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:36.894745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:36.900354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:36.901009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:36.901286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:36.901556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] PATH_INFO: `/v3/users/6a720b8d53cc41e0990cb1c4a8fa4c27` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:36.902760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] RBAC: Authorizing `identity:get_user(user_id=6a720b8d53cc41e0990cb1c4a8fa4c27)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:36.904268 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:36.905947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 426/836] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/users/6a720b8d53cc41e0990cb1c4a8fa4c27 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:36.912486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:37.015682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd74c0-d0bc-4321-b361-6d3a50f9cd79 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:37.039203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:37.052022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:37.053019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:37.053635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:37.053910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:37.121909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:37.123363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:37.223165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 411/837] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:58:37.229382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:37.335769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ff87-df3a-46ee-8b49-6d17fd81369a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:37.369083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c0291-9679-41dd-8a61-c40aa029a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:37.369712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0291-9679-41dd-8a61-c40aa029a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:37.369994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0291-9679-41dd-8a61-c40aa029a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:37.370273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0291-9679-41dd-8a61-c40aa029a1d6 None admin] PATH_INFO: `/v3/projects/d92d3cfabc494d2ca0836562016908d7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:37.371381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0291-9679-41dd-8a61-c40aa029a1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=d92d3cfabc494d2ca0836562016908d7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:37.372840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0291-9679-41dd-8a61-c40aa029a1d6 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:37.374464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 427/838] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:58:37 2022] GET /identity/v3/projects/d92d3cfabc494d2ca0836562016908d7 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:37.380628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:37.405311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:37.481261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcb12a-78e4-40d8-80d5-b0c83b7e74f0 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:37.517945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:37.518554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:37.518836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:37.519113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:37.520474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=d92d3cfabc494d2ca0836562016908d7, user.id=6a720b8d53cc41e0990cb1c4a8fa4c27) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:37.520783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:37.522217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a51e2-28a1-44a1-b218-227539b798f4 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:37.528201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 412/839] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:37 2022] GET /identity/v3/role_assignments?user.id=6a720b8d53cc41e0990cb1c4a8fa4c27&scope.project.id=d92d3cfabc494d2ca0836562016908d7&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:39.638700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cebe2-4cd1-4f29-aef6-b01a1f8e3013 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:39.639262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cebe2-4cd1-4f29-aef6-b01a1f8e3013 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:39.639262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cebe2-4cd1-4f29-aef6-b01a1f8e3013 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:39.640601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 428/840] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:39.646295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:39.646683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:39.646825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:39.664838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:39.666003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:39.731100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 413/841] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:39.992660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cebe2-4cd1-4f29-aef6-b01a1f8e3013 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:40.056933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:40.090524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cebe2-4cd1-4f29-aef6-b01a1f8e3013 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:40.121740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402468d9-93db-4052-a777-52d70b01c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:40.122346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402468d9-93db-4052-a777-52d70b01c45a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:40.122620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402468d9-93db-4052-a777-52d70b01c45a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:40.122887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402468d9-93db-4052-a777-52d70b01c45a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:40.123984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402468d9-93db-4052-a777-52d70b01c45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:40.125396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402468d9-93db-4052-a777-52d70b01c45a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:40.126905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 429/842] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:40.133084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:40.150330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:40.227229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b653c-a6ff-4861-af23-6a3bd46dfb12 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:40.260467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee318b-ed02-407f-8769-445f08930363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:40.260998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee318b-ed02-407f-8769-445f08930363 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:40.261277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee318b-ed02-407f-8769-445f08930363 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:40.261548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee318b-ed02-407f-8769-445f08930363 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:40.262193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee318b-ed02-407f-8769-445f08930363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:40.263639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee318b-ed02-407f-8769-445f08930363 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:40.283698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 414/843] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:58:40 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:42.420632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981b498-e00e-4068-b639-ff0faf54ce0d None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:42.421182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981b498-e00e-4068-b639-ff0faf54ce0d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:42.421182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981b498-e00e-4068-b639-ff0faf54ce0d None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:42.422490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 430/844] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:42.428139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:42.428834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:42.428955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:42.446503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:42.447747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:42.510636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 415/845] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:42.777562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981b498-e00e-4068-b639-ff0faf54ce0d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:42.873531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981b498-e00e-4068-b639-ff0faf54ce0d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:42.905870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:42.906472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:42.906746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:42.907010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] PATH_INFO: `/v3/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:42.908391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] RBAC: Authorizing `identity:get_role(role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:42.909726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:42.911007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 431/846] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:42 2022] GET /identity/v3/roles/5777ac04a7a942daa22c6642ded5268a => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:42.916643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:42.918793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:43.012331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d62d-30b1-464f-b073-3e59cd474bf4 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:43.044448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:43.045062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:43.045345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:43.045622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] PATH_INFO: `/v3/users/41cb334211404b5087906e83ad9a66ad` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:43.060051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] RBAC: Authorizing `identity:get_user(user_id=41cb334211404b5087906e83ad9a66ad)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:43.061501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:43.063105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 416/847] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:42 2022] GET /identity/v3/users/41cb334211404b5087906e83ad9a66ad => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:43.069367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:43.073107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:43.165241 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c22a96-a1bd-44fb-9e4b-8de4e1bd3647 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:43.197129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4311c-c88b-4a48-87b9-589d24d83f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:43.197743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4311c-c88b-4a48-87b9-589d24d83f50 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:43.198016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4311c-c88b-4a48-87b9-589d24d83f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:43.198282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4311c-c88b-4a48-87b9-589d24d83f50 None admin] PATH_INFO: `/v3/projects/d92d3cfabc494d2ca0836562016908d7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:43.199372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4311c-c88b-4a48-87b9-589d24d83f50 None admin] RBAC: Authorizing `identity:get_project(project_id=d92d3cfabc494d2ca0836562016908d7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:43.200813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4311c-c88b-4a48-87b9-589d24d83f50 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:43.202387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 432/848] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:58:43 2022] GET /identity/v3/projects/d92d3cfabc494d2ca0836562016908d7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:43.208726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:43.264865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:43.303825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2530-8f40-480d-8541-057d084434d8 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:43.335848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcc3ce-4023-4204-9936-81aff61bd665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:43.336487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcc3ce-4023-4204-9936-81aff61bd665 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:43.336773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcc3ce-4023-4204-9936-81aff61bd665 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:43.337043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcc3ce-4023-4204-9936-81aff61bd665 None admin] PATH_INFO: `/v3/projects/d92d3cfabc494d2ca0836562016908d7/users/41cb334211404b5087906e83ad9a66ad/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:43.339143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcc3ce-4023-4204-9936-81aff61bd665 None admin] RBAC: Authorizing `identity:create_grant(project_id=d92d3cfabc494d2ca0836562016908d7, user_id=41cb334211404b5087906e83ad9a66ad, role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:43.340597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcc3ce-4023-4204-9936-81aff61bd665 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:43.353346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 417/849] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:58:43 2022] PUT /identity/v3/projects/d92d3cfabc494d2ca0836562016908d7/users/41cb334211404b5087906e83ad9a66ad/roles/5777ac04a7a942daa22c6642ded5268a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:58:45.433361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab760b78-6ac0-460a-b699-c7a9f022c897 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:45.433911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab760b78-6ac0-460a-b699-c7a9f022c897 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:45.433911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab760b78-6ac0-460a-b699-c7a9f022c897 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:45.435205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 433/850] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:45.440563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:45.440951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:45.441108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:45.459120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:45.460319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:45.523228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 418/851] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:45.788114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab760b78-6ac0-460a-b699-c7a9f022c897 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:45.855924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:45.885366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab760b78-6ac0-460a-b699-c7a9f022c897 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:45.917077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:45.917683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:45.917954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:45.918221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] PATH_INFO: `/v3/roles/5777ac04a7a942daa22c6642ded5268a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:45.919596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] RBAC: Authorizing `identity:get_role(role_id=5777ac04a7a942daa22c6642ded5268a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:45.920948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:45.922284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 434/852] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:45 2022] GET /identity/v3/roles/5777ac04a7a942daa22c6642ded5268a => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:45.927890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:45.974985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:46.022722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fe65-bd27-474d-b67a-8ac5141cc12f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:46.054047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:46.054650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:46.054923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:46.055191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] PATH_INFO: `/v3/users/41cb334211404b5087906e83ad9a66ad` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:46.056308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] RBAC: Authorizing `identity:get_user(user_id=41cb334211404b5087906e83ad9a66ad)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:46.057722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:46.059251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 419/853] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:45 2022] GET /identity/v3/users/41cb334211404b5087906e83ad9a66ad => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:46.064784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:46.159712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a6fe-6e10-4902-a133-672b618a934f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:46.190793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:46.191920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:46.192195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:46.192462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:46.202105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:46.256369 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:46.257791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:46.349403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 435/854] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:58:46.355354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:46.450634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7e6d-d59d-4754-8065-f0142287860b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:46.466828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:46.482731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eed25-e50b-4205-8035-7b1667feb3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:46.483337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eed25-e50b-4205-8035-7b1667feb3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:46.483642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eed25-e50b-4205-8035-7b1667feb3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:46.483910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eed25-e50b-4205-8035-7b1667feb3c5 None admin] PATH_INFO: `/v3/projects/d92d3cfabc494d2ca0836562016908d7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:46.485001 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eed25-e50b-4205-8035-7b1667feb3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=d92d3cfabc494d2ca0836562016908d7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:46.486407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eed25-e50b-4205-8035-7b1667feb3c5 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:46.488030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 420/855] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:58:46 2022] GET /identity/v3/projects/d92d3cfabc494d2ca0836562016908d7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:46.494668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:46.533620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:46.589121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefac75-3a72-44db-bb29-efb4cd09e700 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:46.621365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:46.621891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:46.622166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:46.622432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:46.623137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] RBAC: Adding query filter params (role.id=5777ac04a7a942daa22c6642ded5268a, scope.project.id=d92d3cfabc494d2ca0836562016908d7, user.id=41cb334211404b5087906e83ad9a66ad) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:46.623466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:46.624859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49943640-f7c5-46fc-8f7f-f3e2e8248fe7 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:46.630295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 436/856] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:46 2022] GET /identity/v3/role_assignments?user.id=41cb334211404b5087906e83ad9a66ad&scope.project.id=d92d3cfabc494d2ca0836562016908d7&role.id=5777ac04a7a942daa22c6642ded5268a => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:48.755533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b0302-db7f-4c33-ac8b-9aeee94e7059 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:48.755958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b0302-db7f-4c33-ac8b-9aeee94e7059 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:48.756081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b0302-db7f-4c33-ac8b-9aeee94e7059 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:48.757418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 421/857] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:48.762552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:48.762990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:48.763090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:48.781765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:48.782945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:48.845995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 437/858] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:49.112188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b0302-db7f-4c33-ac8b-9aeee94e7059 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:49.208819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b0302-db7f-4c33-ac8b-9aeee94e7059 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:49.240720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b23040-19da-4164-a1e4-d5ef9b1bf3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:49.241326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b23040-19da-4164-a1e4-d5ef9b1bf3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:49.241604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b23040-19da-4164-a1e4-d5ef9b1bf3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:49.241873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b23040-19da-4164-a1e4-d5ef9b1bf3e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:49.242956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b23040-19da-4164-a1e4-d5ef9b1bf3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:49.244431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b23040-19da-4164-a1e4-d5ef9b1bf3e7 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:49.245955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 422/859] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:49.251583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:49.283629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:49.346061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616dd6c-2ffa-462d-8795-c05303258a07 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:49.378532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29922df3-810c-462a-9cfc-4636981a2d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:49.379637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922df3-810c-462a-9cfc-4636981a2d40 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:49.379914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922df3-810c-462a-9cfc-4636981a2d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:49.380184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29922df3-810c-462a-9cfc-4636981a2d40 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:49.380815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29922df3-810c-462a-9cfc-4636981a2d40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:49.382225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29922df3-810c-462a-9cfc-4636981a2d40 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:49.406454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 438/860] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:58:49 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:51.544400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1729-4d4b-422f-ade6-52a985662b60 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:51.544937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1729-4d4b-422f-ade6-52a985662b60 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:51.544937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1729-4d4b-422f-ade6-52a985662b60 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:51.546295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 423/861] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:51.551597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:51.552015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:51.552147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:51.569965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:51.571144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:51.634448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 439/862] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:51.903184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1729-4d4b-422f-ade6-52a985662b60 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:51.958112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:52.000473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1729-4d4b-422f-ade6-52a985662b60 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:52.033084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb124e1-b511-4dc4-96ae-37da92390f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:52.033694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb124e1-b511-4dc4-96ae-37da92390f64 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:52.033976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb124e1-b511-4dc4-96ae-37da92390f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:52.034249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb124e1-b511-4dc4-96ae-37da92390f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:52.035370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb124e1-b511-4dc4-96ae-37da92390f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:52.036823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb124e1-b511-4dc4-96ae-37da92390f64 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:52.038354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 424/863] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 12:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:52.043967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:52.060823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:52.138539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a554b-82c6-4947-9641-57d070aa09f2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:52.170598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2416d-6160-4cf6-93a2-40def7b63424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:52.171123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2416d-6160-4cf6-93a2-40def7b63424 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:52.171424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2416d-6160-4cf6-93a2-40def7b63424 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:52.171694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2416d-6160-4cf6-93a2-40def7b63424 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:52.172338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2416d-6160-4cf6-93a2-40def7b63424 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:52.173762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2416d-6160-4cf6-93a2-40def7b63424 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:52.194592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 440/864] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:58:52 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:58:54.330259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1edb3-1b28-4898-9b75-f2f0d8a89d6d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:54.330815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1edb3-1b28-4898-9b75-f2f0d8a89d6d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:54.330815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1edb3-1b28-4898-9b75-f2f0d8a89d6d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:54.332743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 425/865] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:54.337830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:54.338218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:54.338381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:54.355979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:54.357160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:54.419960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 441/866] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:54.683772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1edb3-1b28-4898-9b75-f2f0d8a89d6d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:54.781341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1edb3-1b28-4898-9b75-f2f0d8a89d6d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:54.803226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:54.814909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:54.815558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:54.815841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:54.816114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:54.825824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:54.830670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:54.831848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:58:54.833506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 426/867] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:54.838293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:54.840483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:54.934967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f21eb-9ad0-4386-a573-412c1c9e9cf3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:54.967781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:54.968370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:54.968651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:54.968925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:54.969580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:54.969888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:54.971250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:54.978978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 442/868] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 12:58:54.984510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:55.079775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5277d-6836-4483-bc09-22bba43c4d87 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:55.112186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:55.112794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:55.113075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:55.113934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] PATH_INFO: `/v3/users/df67179775634ad1b02776197d61f75a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:55.128808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] RBAC: Authorizing `identity:get_user(user_id=df67179775634ad1b02776197d61f75a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:55.131331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:55.133406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 427/869] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:54 2022] GET /identity/v3/users/df67179775634ad1b02776197d61f75a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:55.139156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:55.199760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:55.237400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc67e3-09fd-4910-809c-9e8961dacc91 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:55.269189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f91653-fe20-4351-ba7d-2baca601d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:55.270302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f91653-fe20-4351-ba7d-2baca601d28f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:55.270580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f91653-fe20-4351-ba7d-2baca601d28f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:55.270854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f91653-fe20-4351-ba7d-2baca601d28f None admin] PATH_INFO: `/v3/projects/4605d95a49ca4a11883428cc9f528644` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:55.271987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f91653-fe20-4351-ba7d-2baca601d28f None admin] RBAC: Authorizing `identity:get_project(project_id=4605d95a49ca4a11883428cc9f528644)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:55.273414 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f91653-fe20-4351-ba7d-2baca601d28f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:55.275004 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 443/870] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:58:55 2022] GET /identity/v3/projects/4605d95a49ca4a11883428cc9f528644 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:55.280891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:55.321489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:55.376950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90d4ca-e284-47ac-85f5-0e1a4ff7ec43 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:55.408732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e31cac-c2a7-453c-a2a8-175db9036567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:55.409361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31cac-c2a7-453c-a2a8-175db9036567 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:55.409635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31cac-c2a7-453c-a2a8-175db9036567 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:55.409899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31cac-c2a7-453c-a2a8-175db9036567 None admin] PATH_INFO: `/v3/projects/4605d95a49ca4a11883428cc9f528644/users/df67179775634ad1b02776197d61f75a/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:55.411830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e31cac-c2a7-453c-a2a8-175db9036567 None admin] RBAC: Authorizing `identity:create_grant(project_id=4605d95a49ca4a11883428cc9f528644, user_id=df67179775634ad1b02776197d61f75a, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:55.413235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e31cac-c2a7-453c-a2a8-175db9036567 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:55.425505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 428/871] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:58:55 2022] PUT /identity/v3/projects/4605d95a49ca4a11883428cc9f528644/users/df67179775634ad1b02776197d61f75a/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:58:57.491395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51508-60c9-46d1-879f-6554d9194a59 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:57.491941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51508-60c9-46d1-879f-6554d9194a59 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:57.491941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51508-60c9-46d1-879f-6554d9194a59 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:57.493277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 444/872] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:58:57.498495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:57.498864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:57.499048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:57.517257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:58:57.518445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:58:57.582048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 429/873] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:58:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:58:57.850027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf51508-60c9-46d1-879f-6554d9194a59 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:57.945250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf51508-60c9-46d1-879f-6554d9194a59 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:57.972688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:57.977622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:57.978231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:57.978506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:57.978786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:57.988445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:58:57.993235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:58:57.994282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:58:57.995137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 445/874] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:58:58.000295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:58.029478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:58.096542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e335e1-7941-455b-b601-d203addfffd6 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:58.128254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:58.129405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:58.129688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:58.129961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:58.130620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:58.130921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:58.132307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:58.139948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 430/875] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:58.146272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:58.241397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545459-beb8-4866-84a0-5a3c0c2ba083 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:58.273911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:58.274519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:58.274797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:58.275069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] PATH_INFO: `/v3/users/df67179775634ad1b02776197d61f75a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:58.276198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] RBAC: Authorizing `identity:get_user(user_id=df67179775634ad1b02776197d61f75a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:58.277612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:58.279144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 446/876] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:58:58 2022] GET /identity/v3/users/df67179775634ad1b02776197d61f75a => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:58.284642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:58.370894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:58.380256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bec8-94bc-467b-838e-a14fb67329e6 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:58.411505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:58.412091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:58.412374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:58.412646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:58.476390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:58.477829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:58.562349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:58.572246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 431/877] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:58:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:58:58.578024 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:58.635132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:58:58.674489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfdd3f-ad8c-471c-8457-a52b3e126a5d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:58.707108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d8ffd-01ff-4ef4-ab26-3eb887ceeea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:58.707742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d8ffd-01ff-4ef4-ab26-3eb887ceeea2 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:58.708022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d8ffd-01ff-4ef4-ab26-3eb887ceeea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:58.708295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d8ffd-01ff-4ef4-ab26-3eb887ceeea2 None admin] PATH_INFO: `/v3/projects/4605d95a49ca4a11883428cc9f528644` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:58.709396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d8ffd-01ff-4ef4-ab26-3eb887ceeea2 None admin] RBAC: Authorizing `identity:get_project(project_id=4605d95a49ca4a11883428cc9f528644)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:58.710818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d8ffd-01ff-4ef4-ab26-3eb887ceeea2 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:58.712607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 447/878] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:58:58 2022] GET /identity/v3/projects/4605d95a49ca4a11883428cc9f528644 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:58:58.718477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:58:58.811770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bff8-351a-44c1-a391-49be6b6dfe92 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:58:58.844349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:58:58.844931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:58:58.845207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:58:58.845474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:58:58.846174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=4605d95a49ca4a11883428cc9f528644, user.id=df67179775634ad1b02776197d61f75a) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:58:58.846475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:58:58.848437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e58a48-1d66-4bfc-b919-1e901bada2b3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:58:58.853818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 432/879] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:58:58 2022] GET /identity/v3/role_assignments?user.id=df67179775634ad1b02776197d61f75a&scope.project.id=4605d95a49ca4a11883428cc9f528644&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:00.952614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd305-1672-4452-8f1e-6ea35ffdf03a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:00.953122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd305-1672-4452-8f1e-6ea35ffdf03a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:00.953207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd305-1672-4452-8f1e-6ea35ffdf03a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:00.954468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 448/880] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:59:00.959761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537a98f-fb45-45ff-845d-65a3c761f690 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:00.960170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537a98f-fb45-45ff-845d-65a3c761f690 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:00.960346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537a98f-fb45-45ff-845d-65a3c761f690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:00.978573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9537a98f-fb45-45ff-845d-65a3c761f690 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:59:00.979725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9537a98f-fb45-45ff-845d-65a3c761f690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:59:01.026985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:01.043300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 433/881] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:59:01.313721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd305-1672-4452-8f1e-6ea35ffdf03a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:01.409537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd305-1672-4452-8f1e-6ea35ffdf03a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:01.435583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:01.443267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3cc4f-ce1d-46dd-a9fd-f39d02e4257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:01.443901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3cc4f-ce1d-46dd-a9fd-f39d02e4257e None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:01.444184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3cc4f-ce1d-46dd-a9fd-f39d02e4257e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:01.444452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3cc4f-ce1d-46dd-a9fd-f39d02e4257e None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:01.445101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3cc4f-ce1d-46dd-a9fd-f39d02e4257e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:01.446452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3cc4f-ce1d-46dd-a9fd-f39d02e4257e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:01.461351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 449/882] 10.222.0.25 () {60 vars in 1138 bytes} [Thu Oct 13 12:59:01 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:59:03.589586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01564621-b731-47bf-ab7c-bb1fe77ba9de None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:03.590129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01564621-b731-47bf-ab7c-bb1fe77ba9de None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:03.590129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01564621-b731-47bf-ab7c-bb1fe77ba9de None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:03.591776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 434/883] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:59:03.597118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:03.597962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:03.598420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:03.617116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:59:03.618319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:59:03.683735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 450/884] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:59:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:59:03.948726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01564621-b731-47bf-ab7c-bb1fe77ba9de None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:04.045016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01564621-b731-47bf-ab7c-bb1fe77ba9de None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:04.076999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f9cce-23ba-4920-bee2-ac6563c0717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:04.077605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f9cce-23ba-4920-bee2-ac6563c0717e None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:04.077879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f9cce-23ba-4920-bee2-ac6563c0717e None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:04.078144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f9cce-23ba-4920-bee2-ac6563c0717e None admin] PATH_INFO: `/v3/domains/c871fa95d94447a0adfd02614113b397` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:04.088177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f9cce-23ba-4920-bee2-ac6563c0717e None admin] RBAC: Authorizing `identity:get_domain(domain_id=c871fa95d94447a0adfd02614113b397)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:04.089598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f9cce-23ba-4920-bee2-ac6563c0717e None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:04.091145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 435/885] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Oct 13 12:59:03 2022] GET /identity/v3/domains/c871fa95d94447a0adfd02614113b397 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:04.096743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:04.193179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283f77-d8fb-4e29-aa52-c377f2642b17 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:04.209904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:04.227456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a54f9-f156-4ccd-93ab-24dfdc975d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:04.228050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a54f9-f156-4ccd-93ab-24dfdc975d9f None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:04.228327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a54f9-f156-4ccd-93ab-24dfdc975d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:04.228595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a54f9-f156-4ccd-93ab-24dfdc975d9f None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:04.229242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a54f9-f156-4ccd-93ab-24dfdc975d9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:04.230660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a54f9-f156-4ccd-93ab-24dfdc975d9f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:04.255811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 451/886] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 12:59:04 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:59:06.391773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804012f6-5af1-423f-aa90-190d0c3b5953 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:06.392330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804012f6-5af1-423f-aa90-190d0c3b5953 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:06.392330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804012f6-5af1-423f-aa90-190d0c3b5953 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:06.393648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 436/887] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:59:06.399351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:06.399746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:06.399925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:06.417578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:59:06.418786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:59:06.481529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 452/888] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:59:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:59:06.747176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804012f6-5af1-423f-aa90-190d0c3b5953 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:06.793250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:06.844945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804012f6-5af1-423f-aa90-190d0c3b5953 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:06.877190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1760e-eeb5-4a53-8c94-9c7a2c3bef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:06.877800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1760e-eeb5-4a53-8c94-9c7a2c3bef50 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:06.878077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1760e-eeb5-4a53-8c94-9c7a2c3bef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:06.878345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1760e-eeb5-4a53-8c94-9c7a2c3bef50 None admin] PATH_INFO: `/v3/domains/c871fa95d94447a0adfd02614113b397` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:06.879527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1760e-eeb5-4a53-8c94-9c7a2c3bef50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c871fa95d94447a0adfd02614113b397)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:06.880942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1760e-eeb5-4a53-8c94-9c7a2c3bef50 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:06.882469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 437/889] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Oct 13 12:59:06 2022] GET /identity/v3/domains/c871fa95d94447a0adfd02614113b397 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:06.888199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:06.979591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:06.982520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09456e57-e7d3-4854-a833-9366eeba4146 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:07.016482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450f815-949e-4a99-8b85-fb8a69d4e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:07.017081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450f815-949e-4a99-8b85-fb8a69d4e7ea None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:07.017367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450f815-949e-4a99-8b85-fb8a69d4e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:07.017641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450f815-949e-4a99-8b85-fb8a69d4e7ea None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:07.018299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450f815-949e-4a99-8b85-fb8a69d4e7ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:07.019755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450f815-949e-4a99-8b85-fb8a69d4e7ea None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:07.040172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 453/890] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 12:59:06 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 12:59:09.168257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c858-1d4a-4e64-b90b-2f355a7b4074 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:09.168829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c858-1d4a-4e64-b90b-2f355a7b4074 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:09.168829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c858-1d4a-4e64-b90b-2f355a7b4074 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:09.170123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 438/891] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:59:09.175278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:09.175737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:09.175882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:09.194201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:59:09.195385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:59:09.258292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 454/892] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:59:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 12:59:09.525321 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60c858-1d4a-4e64-b90b-2f355a7b4074 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:09.622873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60c858-1d4a-4e64-b90b-2f355a7b4074 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:09.636121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:09.656150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:09.656765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:09.657047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:09.657319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:09.667605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:59:09.672380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:59:09.673557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 12:59:09.674501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 439/893] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:59:09.679777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:09.759434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:09.775452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2832d-7e34-4a76-bf7a-a6302bda5ccc None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:09.808367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:09.808958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:09.809235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:09.809504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:09.810153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:59:09.810451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:09.811832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:09.819597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 455/894] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:09.825192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:09.919723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e279-031f-464a-8ba5-f7580236fc99 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:09.952280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:09.952877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:09.953150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:09.953419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] PATH_INFO: `/v3/users/433bb77999ba43db856febe01d95d320` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:09.966153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] RBAC: Authorizing `identity:get_user(user_id=433bb77999ba43db856febe01d95d320)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:09.967591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:09.969120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 440/895] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:59:09 2022] GET /identity/v3/users/433bb77999ba43db856febe01d95d320 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:09.974668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:10.069075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee0da6-1e4b-4199-8f95-baf3ccdacb2c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:10.100740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da890b-c5ee-4688-999e-37286dc92ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:10.101354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da890b-c5ee-4688-999e-37286dc92ded None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:10.101630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da890b-c5ee-4688-999e-37286dc92ded None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:10.101899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da890b-c5ee-4688-999e-37286dc92ded None admin] PATH_INFO: `/v3/projects/061bdcdef94f4caea2fe7634a3569408` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:10.102995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da890b-c5ee-4688-999e-37286dc92ded None admin] RBAC: Authorizing `identity:get_project(project_id=061bdcdef94f4caea2fe7634a3569408)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:10.104435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da890b-c5ee-4688-999e-37286dc92ded None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:10.106041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 456/896] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:59:09 2022] GET /identity/v3/projects/061bdcdef94f4caea2fe7634a3569408 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:10.112051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:10.141867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:10.208838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148280f-bfe7-43a9-879e-9469f0044d40 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:10.240973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d814161-617d-466a-9eec-d04b6a49e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:10.241613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d814161-617d-466a-9eec-d04b6a49e61a None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:10.241890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d814161-617d-466a-9eec-d04b6a49e61a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:10.242160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d814161-617d-466a-9eec-d04b6a49e61a None admin] PATH_INFO: `/v3/projects/061bdcdef94f4caea2fe7634a3569408/users/433bb77999ba43db856febe01d95d320/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:10.244042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d814161-617d-466a-9eec-d04b6a49e61a None admin] RBAC: Authorizing `identity:create_grant(project_id=061bdcdef94f4caea2fe7634a3569408, user_id=433bb77999ba43db856febe01d95d320, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:10.245465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d814161-617d-466a-9eec-d04b6a49e61a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:10.257910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 441/897] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 12:59:10 2022] PUT /identity/v3/projects/061bdcdef94f4caea2fe7634a3569408/users/433bb77999ba43db856febe01d95d320/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 12:59:12.343886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29a68-d532-4cc2-8074-c12d8400211d None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:12.344410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29a68-d532-4cc2-8074-c12d8400211d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:12.344410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29a68-d532-4cc2-8074-c12d8400211d None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:12.345757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 457/898] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 12:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 12:59:12.350889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:12.351285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:12.351453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:12.369091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 12:59:12.370267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 12:59:12.434582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 442/899] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 12:59:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 12:59:12.704156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d29a68-d532-4cc2-8074-c12d8400211d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:12.722549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:12.802141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d29a68-d532-4cc2-8074-c12d8400211d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:12.833967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:12.834576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:12.834848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:12.835114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:12.844642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 12:59:12.849985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 12:59:12.851063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 12:59:12.852003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 458/900] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 12:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 12:59:12.857053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:12.880240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:12.953190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cc53f-be18-4898-87c7-83b53013c54e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:12.985638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:12.986178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:12.986458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:12.986731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:12.987391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:59:12.987723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:12.989666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:12.997320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 443/901] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 12:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:13.003000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:13.075707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:13.099662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18559063-44f8-4a91-8e0f-dbf973742fde None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:13.131931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:13.132545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:13.132823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:13.133093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] PATH_INFO: `/v3/users/433bb77999ba43db856febe01d95d320` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:13.134196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] RBAC: Authorizing `identity:get_user(user_id=433bb77999ba43db856febe01d95d320)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:13.135645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:13.137204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 459/902] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 12:59:13 2022] GET /identity/v3/users/433bb77999ba43db856febe01d95d320 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:13.143093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:13.230000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:13.245322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b73621-3c80-437b-8d36-0dde69af7767 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:13.277303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:13.277902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:13.278182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:13.278453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:13.342348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:13.343821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:13.422010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:13.438126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 444/903] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 12:59:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 12:59:13.444063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:13.539647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ba1a4-9785-4b3b-80d5-0a8a5d313785 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:13.570964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7dc0-de38-42cc-b4da-e4cd9029eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:13.571602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7dc0-de38-42cc-b4da-e4cd9029eeec None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:13.571882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7dc0-de38-42cc-b4da-e4cd9029eeec None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:13.572155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7dc0-de38-42cc-b4da-e4cd9029eeec None admin] PATH_INFO: `/v3/projects/061bdcdef94f4caea2fe7634a3569408` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:13.573256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7dc0-de38-42cc-b4da-e4cd9029eeec None admin] RBAC: Authorizing `identity:get_project(project_id=061bdcdef94f4caea2fe7634a3569408)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:13.574676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7dc0-de38-42cc-b4da-e4cd9029eeec None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:13.576292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 460/904] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 12:59:13 2022] GET /identity/v3/projects/061bdcdef94f4caea2fe7634a3569408 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:13.582061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 12:59:13.675975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c7e22-e578-415f-bd64-16b270cadb35 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 12:59:13.708708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 12:59:13.709293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 12:59:13.709573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 12:59:13.709844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 12:59:13.710553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=061bdcdef94f4caea2fe7634a3569408, user.id=433bb77999ba43db856febe01d95d320) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 12:59:13.710861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 12:59:13.712373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac4b52-1dac-4c16-ace9-0bcd9b1d8f9a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 12:59:13.718052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 445/905] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 12:59:13 2022] GET /identity/v3/role_assignments?user.id=433bb77999ba43db856febe01d95d320&scope.project.id=061bdcdef94f4caea2fe7634a3569408&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 12:59:23.566931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 12:59:23.715507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=76 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:08.665387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fa9c-0868-4109-8bef-1d9524dc6fbb None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:08.665387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fa9c-0868-4109-8bef-1d9524dc6fbb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:08.665387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fa9c-0868-4109-8bef-1d9524dc6fbb None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:08.665387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 461/906] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:08.671331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:08.671917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:08.671917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:08.693257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:08.696543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:08.793520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 446/907] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 13:00:09.065131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6fa9c-0868-4109-8bef-1d9524dc6fbb None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:09.197513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6fa9c-0868-4109-8bef-1d9524dc6fbb None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:09.242745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:09.243471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:09.243752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:09.243979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:09.255636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:09.257632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:09.279605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:09.280922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:09.282111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:09.282111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:09.282111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:09.285879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 462/908] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 13:00:09.286976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:09.427897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a0f4d-bd93-4ecd-aa9f-0fa66a0a440c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:09.469836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:09.476959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:09.477863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:09.478357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:09.478746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:09.480029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:09.480351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:09.481854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63feca-dd06-41b4-8876-a89a68949600 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:09.498130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 447/909] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:00:09.503861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:09.579343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:09.650961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507161-bae1-40a0-924b-2b2ee2b2383a None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:09.691213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aeb5f-7ef6-4442-9463-85eaae42d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:09.692004 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aeb5f-7ef6-4442-9463-85eaae42d4a1 None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:09.692300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aeb5f-7ef6-4442-9463-85eaae42d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:09.692507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aeb5f-7ef6-4442-9463-85eaae42d4a1 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:09.693292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781aeb5f-7ef6-4442-9463-85eaae42d4a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:09.695659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781aeb5f-7ef6-4442-9463-85eaae42d4a1 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:09.725298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 463/910] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 13:00:09 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:00:12.354698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2375c-8937-40b7-8955-180914aaa421 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:12.355284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2375c-8937-40b7-8955-180914aaa421 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:12.355284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2375c-8937-40b7-8955-180914aaa421 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:12.356944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 448/911] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:12.363216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:12.363817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:12.363817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:12.386861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:12.388118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:12.474981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 464/912] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:12.753819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2375c-8937-40b7-8955-180914aaa421 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:12.863255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2375c-8937-40b7-8955-180914aaa421 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:12.903144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:12.903768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:12.904049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:12.904317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:12.915676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 13:00:12.920450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:12.921468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:12.922394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 449/913] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 13:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:12.927652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:12.972350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:13.041846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a9716-1644-4db4-b208-3a2fecc26eb6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:13.077364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:13.077976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:13.078255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:13.078646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:13.079569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:13.079760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:13.081130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:13.089543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 465/914] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 13:00:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:13.095251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:13.149529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:13.207423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e14d15-5353-4523-b580-c10ecabab4af None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:13.244620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:13.245195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:13.245567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:13.245812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:13.257390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:13.258907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:13.274865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:13.276123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:13.277130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:13.277130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:13.277130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:13.277130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 450/915] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:13.282532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:13.387273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:13.390695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976302e-195f-4cb9-b99e-e022eb68ee4f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:13.428081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:13.428771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:13.429151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:13.429467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:13.430297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:13.430669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:13.431980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:13.452007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 466/916] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:13.453005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:13.578796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262201a-2391-4b2e-a27f-351f52c25e93 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:13.580561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:13.621849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:13.622664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:13.622949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:13.623232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:13.634883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:13.636368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 13:00:13.650412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:13.656398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:13.657390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 451/917] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:13.658008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:13.775473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42ace-144d-4928-b6a3-a59a4a20eb7c None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:13.810839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:13.811689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:13.812157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:13.812528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:13.813566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:13.814066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:13.815619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:13.835719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 467/918] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 13:00:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:00:13.841730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:13.949777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a95364-798c-4c56-bf18-1f5ca3e0e4d0 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:13.985305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:13.985932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:13.986232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:13.986482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:13.997518 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:13.998980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:14.014601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:14.021549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:14.023175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:14.023175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:14.023175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:14.023175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 452/919] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:14.023644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:14.044903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:14.143601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed368e-66ab-49b7-934f-6488f566df17 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:14.193258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:14.193865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:14.194144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:14.194413 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:14.195053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:14.195355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:14.196738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:14.210743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 468/920] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:14.216170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:14.234865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:14.343284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3001e3-325c-404f-bc93-f54d3a52ca26 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:14.385886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:14.386520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:14.386797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:14.387065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:14.394648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:14.396185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 13:00:14.409104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:14.410209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:14.411417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 453/921] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 13:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:14.416349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:14.536975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:14.575228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c32b8-8fd0-461d-afb7-5248a4b75b34 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:14.618373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:14.618994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:14.619313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:14.619615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:14.620339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:14.620644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:14.622134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770f135-0904-418f-a634-cad9ac236228 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:14.636441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 469/922] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 13:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:00:14.644250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:14.732502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:14.760110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5491c8-921b-42de-9faa-377c24f034e1 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:14.797580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90950e98-7d6a-4cab-a1f0-fd5c651bf9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:14.799023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950e98-7d6a-4cab-a1f0-fd5c651bf9f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:14.799023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950e98-7d6a-4cab-a1f0-fd5c651bf9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:14.799023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950e98-7d6a-4cab-a1f0-fd5c651bf9f6 None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/c8c2cffed4c54b0ea5cbde5b7d3f5b6d/roles/9fc4e63d26c845c080c08c21829f36c6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:14.816156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90950e98-7d6a-4cab-a1f0-fd5c651bf9f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=c8c2cffed4c54b0ea5cbde5b7d3f5b6d, role_id=9fc4e63d26c845c080c08c21829f36c6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:14.817632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90950e98-7d6a-4cab-a1f0-fd5c651bf9f6 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:14.829971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 454/923] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 13:00:14 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/c8c2cffed4c54b0ea5cbde5b7d3f5b6d/roles/9fc4e63d26c845c080c08c21829f36c6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:00:17.134726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ef79-7ec3-434f-a64d-b21e5e47d99a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:17.135356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ef79-7ec3-434f-a64d-b21e5e47d99a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:17.135356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ef79-7ec3-434f-a64d-b21e5e47d99a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:17.136790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 470/924] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:17.142406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:17.142881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:17.142970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:17.161301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:17.162595 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:17.234371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 455/925] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:17.514447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ef79-7ec3-434f-a64d-b21e5e47d99a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:17.620536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ef79-7ec3-434f-a64d-b21e5e47d99a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:17.658205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:17.658837 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:17.659119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:17.659395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:17.667211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:17.672306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 13:00:17.677563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:17.679260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:17.680108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 471/926] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 13:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:17.686011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:17.742359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:17.794940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9dc41-26f6-472b-84dd-9ec52b8df6cb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:17.834652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:17.835389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:17.835745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:17.836075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:17.836801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] RBAC: Adding query filter params (name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:17.837103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:17.838642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:17.847952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 456/927] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 13:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:17.854333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:17.976012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f525f-e7f1-40af-8bd0-7bc5c1b01a21 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:18.012969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:18.013595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:18.013897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:18.014141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:18.024366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:18.025806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:18.042923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:18.044108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:18.045292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:18.045292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:18.045292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:18.045292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 472/928] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:18.050047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:18.154535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbe7ac-a15c-479e-8176-dc6eae5bc13f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:18.171812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:18.190914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:18.191671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:18.191953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:18.192222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:18.192856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:18.193154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:18.194538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:18.206204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 457/929] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:00:18.212573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:18.264207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:18.315449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72661a-7c2e-43f5-bf93-f14b2de9f14b None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:18.352781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:18.353517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:18.353810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:18.354167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:18.362664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:18.364198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 13:00:18.376346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:18.377485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:18.378492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 473/930] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:18.383388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:18.494582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e3b18-4e50-438a-9188-ea2b0b75807a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:18.530471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:18.531312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:18.531639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:18.531981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:18.532854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:18.533191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:18.534922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:18.555181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 458/931] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 13:00:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:18.561504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:18.669609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d065-8cfc-4a83-8c69-97d939bf1906 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:18.680636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:18.703817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:18.704414 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:18.704704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:18.704955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:18.778207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:18.780023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:18.878067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 474/932] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 13:00:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 13:00:18.884312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:18.918181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:18.990715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05648c2-ef0a-441c-83da-a85dfdd1a477 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:19.032987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:19.033746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:19.034032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:19.034307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:19.046119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:19.047713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:19.063985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:19.065266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:19.066486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:19.066486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:19.066486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:19.066486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 459/933] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:19.072018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:19.083803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:19.179296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf996f9-dbec-42d6-b477-03bccd65c38e None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:19.216282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:19.216950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:19.217157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:19.217430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:19.218070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:19.218372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:19.219785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:19.232847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 475/934] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:19.239075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:19.330200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:19.347176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8a63-5f84-44ae-a582-1aae7ce4b10b None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:19.386019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:19.386678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:19.386962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:19.387238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:19.395780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:19.397238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 13:00:19.409573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:19.410463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:19.411347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 460/935] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 13:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:19.417339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:19.503275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:19.542064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfca06-70f6-4d3a-8a79-5fea83bb0716 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:19.577058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:19.577637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:19.577937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:19.578202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:19.578914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:19.579215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:19.580745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f4d06-b61a-40ec-8595-8112464c670a None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:19.592679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 476/936] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 13:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:19.599047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:19.697770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12384-a30a-4c83-b1ac-45a28162361c None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:19.738514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:19.739121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:19.739421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:19.739766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:19.740482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] RBAC: Adding query filter params (role.id=9fc4e63d26c845c080c08c21829f36c6, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=c8c2cffed4c54b0ea5cbde5b7d3f5b6d) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:19.740787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:19.742781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed15563-be71-4cd4-b229-44f2f3b69538 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:19.749711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 461/937] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 13:00:19 2022] GET /identity/v3/role_assignments?user.id=c8c2cffed4c54b0ea5cbde5b7d3f5b6d&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=9fc4e63d26c845c080c08c21829f36c6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:22.098730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e5cf-202a-4f61-8c51-26f6fe0f17bd None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:22.099265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e5cf-202a-4f61-8c51-26f6fe0f17bd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:22.099265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e5cf-202a-4f61-8c51-26f6fe0f17bd None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:22.100807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 477/938] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:22.106634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:22.107098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:22.107328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:22.126515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:22.127753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:22.130564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:22.196183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 462/939] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:22.501651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e5cf-202a-4f61-8c51-26f6fe0f17bd None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:22.611503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e5cf-202a-4f61-8c51-26f6fe0f17bd None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:22.647314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:22.653589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:22.654213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:22.654491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:22.654761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:22.665915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 13:00:22.670728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:22.671993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:22.672905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 478/940] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 13:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:22.678450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:22.788960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a63eb0-7294-4838-9bf6-c864c5857c61 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:22.827896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:22.828506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:22.828786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:22.829066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:22.829734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:22.830037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:22.831548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:22.841673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 463/941] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 13:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:00:22.847578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:22.949628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183359b5-0a04-4aef-b45b-bfa416167136 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:22.984778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:22.985409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:22.985724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:22.985959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:22.996755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:22.998199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:23.014952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:23.016203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:23.017335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:23.017335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:23.017335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:23.017335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 479/942] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:23.022205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:23.025345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:23.136290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e652c-6aaa-47f0-a6e6-0bb21853a0cf None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:23.181244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:23.181899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:23.182179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:23.182448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:23.183352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:23.183691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:23.185208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:23.199634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 464/943] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:23.206601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:23.253174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:23.318339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c2bbc-30bb-437a-baa5-6598fe3512ed None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:23.356850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:23.357527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:23.357808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:23.358085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:23.367146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:23.368627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 13:00:23.380932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:23.382032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:23.383019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 480/944] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:23.388355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:23.456609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:23.502678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342c4f0-334f-4cc2-939d-63585b3f4b83 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:23.540369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:23.541110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:23.541446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:23.541748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:23.542643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:23.542908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:23.544564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:23.563695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 465/945] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 13:00:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:23.570174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:23.680678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0a93-8201-4ac7-9c1d-fc541028319d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:23.682347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:23.724381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:23.725017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:23.725308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:23.725648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:23.737207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:23.738732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:23.753725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:23.754707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:23.755633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:23.755633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:23.755633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:23.755633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 481/946] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:23.761464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:23.868910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8891e-841e-4e35-aaa7-39dd04143b9f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:23.894345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:23.910064 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:23.910684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:23.910995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:23.911298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:23.912020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:23.912363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:23.914067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:23.926893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 466/947] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:23.933672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:24.046976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e010b-8d32-4d14-91a3-81a97a614e2d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:24.086147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:24.086860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:24.087169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:24.087489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:24.094585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:24.096226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 13:00:24.110687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:24.111783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:24.113098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 482/948] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 13:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:24.118003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:24.221326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b62ea-1d7d-4202-bb03-ef8ed2948801 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:24.255909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:24.256514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:24.256796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:24.257607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:24.258297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:24.258597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:24.260066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bff9c-14d6-4db9-9184-31e70b966814 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:24.273770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 467/949] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 13:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:00:24.279950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:24.296249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:24.388255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1abc4-7519-4cc3-a57c-5c44f432d829 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:24.427335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22feb86-3294-40da-9cb9-1af69e24e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:24.428153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22feb86-3294-40da-9cb9-1af69e24e7dd None admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:24.428539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22feb86-3294-40da-9cb9-1af69e24e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:24.429437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22feb86-3294-40da-9cb9-1af69e24e7dd None admin] PATH_INFO: `/v3/projects/f29514a70d30401dbbc899b779affa25/users/c8c2cffed4c54b0ea5cbde5b7d3f5b6d/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:24.431999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22feb86-3294-40da-9cb9-1af69e24e7dd None admin] RBAC: Authorizing `identity:create_grant(project_id=f29514a70d30401dbbc899b779affa25, user_id=c8c2cffed4c54b0ea5cbde5b7d3f5b6d, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:24.433877 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22feb86-3294-40da-9cb9-1af69e24e7dd None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:24.451067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 483/950] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 13:00:24 2022] PUT /identity/v3/projects/f29514a70d30401dbbc899b779affa25/users/c8c2cffed4c54b0ea5cbde5b7d3f5b6d/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:00:26.700296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481f622-a8d4-4634-a9db-8d9e6ac79528 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:26.700296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481f622-a8d4-4634-a9db-8d9e6ac79528 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:26.700296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481f622-a8d4-4634-a9db-8d9e6ac79528 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:26.700296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 468/951] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:00:26.705769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:26.706190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:26.706326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:26.729159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:26.729159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:26.799536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 484/952] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:27.070703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481f622-a8d4-4634-a9db-8d9e6ac79528 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:27.121088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:27.188352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481f622-a8d4-4634-a9db-8d9e6ac79528 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:27.227932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:27.228567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:27.228846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:27.229117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:27.240025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 13:00:27.244859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:27.246120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:27.247298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 469/953] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 13:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:27.252479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:27.255605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:27.362324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ebe20-174a-4b86-97ae-c15308df7049 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:27.405364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:27.405998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:27.406276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:27.406546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:27.407228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:27.407574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:27.408990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:27.418922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 485/954] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 13:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:27.425007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:27.533791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:27.536981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea003acc-a362-4a9f-93f0-1c3918bca033 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:27.576261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:27.576911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:27.577192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:27.577466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:27.590899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:27.593002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:27.609686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:27.610923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:27.612047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:27.612047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:27.612047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:27.615674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 470/955] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:27.616894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:27.684936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:27.721833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0dbdd-dbad-4688-ab88-c03761f467c9 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:27.757830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:27.758448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:27.758727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:27.758997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:27.759677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:27.759982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:27.761374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:27.774506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 486/956] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:27.780357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:27.881656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab076d-4919-4712-891f-30914cbc928f None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:27.915187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:27.915845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:27.916126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:27.916396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:27.923922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:27.925354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 13:00:27.936778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:27.937782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:27.938764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 471/957] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:27.943986 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:28.042260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64755-359f-40c2-a5d0-0363baf6906d None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:28.067901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:28.077219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:28.077822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:28.078102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:28.078372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:28.079090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:28.079393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:28.080911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:28.097935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 487/958] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 13:00:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:28.104533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:28.119947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:28.200567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282316f-89e7-42ef-9d73-3c3ccee33b1a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:28.232766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:28.233353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:28.233634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:28.233905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:28.297920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:28.299354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:28.312237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:28.392278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 472/959] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 13:00:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 13:00:28.398672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:28.503021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4361-831b-4e85-b7aa-c4de1f7ae22f None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:28.534943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:28.535582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:28.535860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:28.536127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:28.546243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:28.547693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 13:00:28.561801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:28.562904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 13:00:28.564035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 13:00:28.564035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 13:00:28.564035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:28.564035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 488/960] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:28.568689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:28.662715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404459-bf19-455b-9963-76e5f974168a None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:28.674866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:28.696277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:28.696861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:28.697137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:28.697403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:28.698029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:28.698325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:28.699708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:28.710894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 473/961] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 13:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:28.716485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:28.750049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:28.812584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564a237-72c1-48a3-aae7-ff09cb21ad86 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:28.846006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:28.846615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:28.846890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:28.847161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:28.853517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:28.854940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 13:00:28.865751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:28.866629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: ERROR keystone.server.flask.application Oct 13 13:00:28.867761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 489/962] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 13:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:28.872561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:28.967629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c32c-fe85-4f6a-88a0-4765ae4cba85 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:28.999413 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:29.000022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:29.000302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:29.000575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:29.001252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:29.001563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:29.002974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9424c-f708-4e56-9b29-74cd489f50c3 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:29.014841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 474/963] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 13:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:29.020906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:29.110070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:29.115996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc950-d7a7-4516-a6ca-6dd3aea92e07 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:29.148302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:29.148888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:29.149169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:29.149441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:29.150146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] RBAC: Adding query filter params (role.id=64eb4dbd7d6c4e6db1560d54941a31f7, scope.project.id=f29514a70d30401dbbc899b779affa25, user.id=c8c2cffed4c54b0ea5cbde5b7d3f5b6d) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:29.150449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:29.151895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692ce46-05da-463e-9d95-af0c020b6200 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:29.157347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 490/964] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 13:00:29 2022] GET /identity/v3/role_assignments?user.id=c8c2cffed4c54b0ea5cbde5b7d3f5b6d&scope.project.id=f29514a70d30401dbbc899b779affa25&role.id=64eb4dbd7d6c4e6db1560d54941a31f7 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:31.291886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca333b-38ff-49b6-9bf8-acdded0ca9bf None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:31.292440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca333b-38ff-49b6-9bf8-acdded0ca9bf None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:31.292440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca333b-38ff-49b6-9bf8-acdded0ca9bf None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:31.293765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 475/965] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:31.298819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:31.299210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:31.299368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:31.317750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:31.318923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:31.381752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 491/966] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:31.678332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca333b-38ff-49b6-9bf8-acdded0ca9bf None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:31.708987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:31.776671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca333b-38ff-49b6-9bf8-acdded0ca9bf None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:31.809412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:31.810021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:31.810297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:31.810565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:31.811130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:31.812515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:31.820956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:31.822135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:31.823156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:31.826812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 476/967] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 13:00:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:31.827876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:31.911734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:31.921909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a3f6-f929-407f-bf90-3bcaa39b324d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:31.954453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:31.954981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:31.955257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:31.955552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:31.956166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:31.956464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:31.957808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2346b0-088a-4625-be52-30b7d9c79b93 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:31.962921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 492/968] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 13:00:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:31.968506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:32.058755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:32.064825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13670d-3725-4541-a446-b423f0dfcf19 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:32.096736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:32.097314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:32.097592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:32.097862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] PATH_INFO: `/v3/services` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:32.098475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] RBAC: Adding query filter params (type=placement) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:32.098772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:32.100150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca744e5-bf74-4057-b60c-d4311fb0d9ae None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:32.105020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 477/969] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 13:00:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:34.212196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885710-8612-47c9-8765-3520969f8faf None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:34.212717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885710-8612-47c9-8765-3520969f8faf None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:34.212717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885710-8612-47c9-8765-3520969f8faf None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:34.214056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 493/970] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:34.219231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230f8d-da78-4b64-984e-9398a05b29f9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:34.219627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230f8d-da78-4b64-984e-9398a05b29f9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:34.219825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230f8d-da78-4b64-984e-9398a05b29f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:34.238029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-65230f8d-da78-4b64-984e-9398a05b29f9 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:34.239226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-65230f8d-da78-4b64-984e-9398a05b29f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:34.302698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 478/971] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:34.569461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9885710-8612-47c9-8765-3520969f8faf None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:34.666230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9885710-8612-47c9-8765-3520969f8faf None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:34.698487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6373-4ea6-4df8-bb63-40e570b1a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:34.699071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6373-4ea6-4df8-bb63-40e570b1a31d None admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:34.699346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6373-4ea6-4df8-bb63-40e570b1a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:34.699642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6373-4ea6-4df8-bb63-40e570b1a31d None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:34.700285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd6373-4ea6-4df8-bb63-40e570b1a31d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:34.701631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd6373-4ea6-4df8-bb63-40e570b1a31d None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:34.715947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 494/972] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 13:00:34 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:00:36.845356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6566-0d6a-4c58-b49b-e5e3e1a6629b None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:36.845894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6566-0d6a-4c58-b49b-e5e3e1a6629b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:36.845894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6566-0d6a-4c58-b49b-e5e3e1a6629b None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:36.847253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 479/973] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:36.852522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:36.852889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:36.853084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:36.870715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:36.871932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:36.880871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:36.943695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 495/974] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:37.209830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef6566-0d6a-4c58-b49b-e5e3e1a6629b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:37.297834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:37.308190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef6566-0d6a-4c58-b49b-e5e3e1a6629b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:37.341440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:37.342053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:37.342334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:37.342609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:37.343185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:37.344588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:37.353712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:37.354688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:37.355879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 480/975] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 13:00:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:37.360678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:37.461285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b81fb-8921-4350-98b6-e40b4233e96a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:37.496508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:37.497113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:37.497417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:37.497691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:37.498322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:37.498623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:37.500025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:37.505347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 496/976] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 13:00:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:37.511319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:37.610565 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092b50-918a-4297-a5a5-a73407dee2bb None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:37.645007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:37.645605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:37.645889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:37.646166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:37.646898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] RBAC: Adding query filter params (interface=public, service_id=12456aaa406141349f32329b8799377c, region_id=RegionOne) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:37.647215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:37.649270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe02356-dc4d-4b33-be1f-e641dbb6baee None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:37.654099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 481/977] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 13:00:37 2022] GET /identity/v3/endpoints?service_id=12456aaa406141349f32329b8799377c&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:37.659759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:37.663416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:37.757381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922926bf-02e0-4483-8f46-c7713d488335 None admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:37.789684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5450-5fbc-47b8-b558-6e51dae7c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:37.790275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5450-5fbc-47b8-b558-6e51dae7c7ff None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:37.790550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5450-5fbc-47b8-b558-6e51dae7c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:37.790819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5450-5fbc-47b8-b558-6e51dae7c7ff None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:37.791434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5450-5fbc-47b8-b558-6e51dae7c7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:37.792779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5450-5fbc-47b8-b558-6e51dae7c7ff None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:37.799173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 497/978] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 13:00:37 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:00:39.900778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a4b3-09ca-4da2-95a6-5cdd7e6e64ab None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:39.901327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a4b3-09ca-4da2-95a6-5cdd7e6e64ab None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:39.901327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a4b3-09ca-4da2-95a6-5cdd7e6e64ab None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:39.902666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 482/979] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:00:39.907854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:39.908255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:39.908400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:39.926016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:00:39.927189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:00:39.985667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:39.991273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 498/980] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:00:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 13:00:40.259137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a4b3-09ca-4da2-95a6-5cdd7e6e64ab None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:40.278480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:40.357441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a4b3-09ca-4da2-95a6-5cdd7e6e64ab None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:40.390577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:40.391192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:40.391500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:40.391769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:40.392342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:40.393691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 13:00:40.402662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 13:00:40.404002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application with Lock( Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self._enter() Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application return self.creator() Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application created_value = creator( Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: ERROR keystone.server.flask.application Oct 13 13:00:40.405097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 483/981] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 13:00:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 13:00:40.409733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:40.509925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179169-267d-4fca-a59e-b0c267ebed7f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:40.543179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:40.543812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:40.544093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:40.544367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] PATH_INFO: `/v3/services` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:40.544991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] RBAC: Adding query filter params (name=placement) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:00:40.545293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:40.546660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f0273-2b5e-4e0d-bfec-d86cc1b63dee None admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:40.551606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 499/982] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 13:00:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:00:40.557642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:00:40.636762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:40.654846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751dc4-e556-4230-ba68-71faab636259 None admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:00:40.686783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1aaa7-8d23-48a2-961b-1e048b8604f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:00:40.687373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1aaa7-8d23-48a2-961b-1e048b8604f8 None admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:00:40.687684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1aaa7-8d23-48a2-961b-1e048b8604f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:00:40.687957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1aaa7-8d23-48a2-961b-1e048b8604f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:00:40.688620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1aaa7-8d23-48a2-961b-1e048b8604f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:00:40.689985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1aaa7-8d23-48a2-961b-1e048b8604f8 None admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:00:40.709396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 484/983] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:00:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:00:50.548786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=69 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:00:50.705203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:44.125353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913b7bf-933f-4ee0-aded-afeae98c2d4b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:44.125353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913b7bf-933f-4ee0-aded-afeae98c2d4b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:44.125989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913b7bf-933f-4ee0-aded-afeae98c2d4b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:44.131537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 500/984] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:01:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:01:44.132424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e468af-db27-4877-a24b-7d241a175ac5 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:44.132845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e468af-db27-4877-a24b-7d241a175ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:44.133048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e468af-db27-4877-a24b-7d241a175ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:44.209905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-95e468af-db27-4877-a24b-7d241a175ac5 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:01:44.211111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-95e468af-db27-4877-a24b-7d241a175ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:44.313543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 485/985] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:01:44.609119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aa373-e017-437a-ba78-17658b501968 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:44.609579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aa373-e017-437a-ba78-17658b501968 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:44.609964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aa373-e017-437a-ba78-17658b501968 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:44.611569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 501/986] 10.222.0.25 () {54 vars in 964 bytes} [Thu Oct 13 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:01:44.617766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879c0d-0436-4a01-8a85-be746d7c066e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:44.618053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879c0d-0436-4a01-8a85-be746d7c066e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:44.618349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879c0d-0436-4a01-8a85-be746d7c066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:44.705303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-bb879c0d-0436-4a01-8a85-be746d7c066e None None] MFA Rules not processed for user `0fd9d9e53d0f4a2ca149de05ff08d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:01:44.706512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-bb879c0d-0436-4a01-8a85-be746d7c066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:44.733620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:44.792655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 486/987] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Oct 13 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:01:44.801896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aa373-e017-437a-ba78-17658b501968 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:01:44.803761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b99aa373-e017-437a-ba78-17658b501968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:44.919620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aa373-e017-437a-ba78-17658b501968 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:01:45.001190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:01:45.001967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:45.002352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:45.002734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:45.004474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:45.063821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:45.129337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:01:45.130988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d1ca4-e709-4302-af2e-59a2324996db service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:01:45.152436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 502/988] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:01:47.586053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c627f1-0962-45bf-aac7-ea2acd915225 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:47.586581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c627f1-0962-45bf-aac7-ea2acd915225 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:47.586581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c627f1-0962-45bf-aac7-ea2acd915225 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:47.587985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 487/989] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:01:47.593139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083e0b-65b1-4f75-a18d-23a5eaff182e None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:47.593577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083e0b-65b1-4f75-a18d-23a5eaff182e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:47.593720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083e0b-65b1-4f75-a18d-23a5eaff182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:47.672812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ee083e0b-65b1-4f75-a18d-23a5eaff182e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:01:47.674036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ee083e0b-65b1-4f75-a18d-23a5eaff182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:47.768484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 503/990] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:01:48.054784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c627f1-0962-45bf-aac7-ea2acd915225 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:01:48.056326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d7c627f1-0962-45bf-aac7-ea2acd915225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:48.161799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c627f1-0962-45bf-aac7-ea2acd915225 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:01:48.233236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:48.235594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:01:48.236212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:48.236495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:48.237122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:48.239251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:48.346719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:01:48.348193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73222ece-d8c2-4cb5-b172-0ac8a82e1b76 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:01:48.366577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 488/991] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:01:50.828672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9306a-181b-4d3c-9450-451005f83bfe None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:50.829191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9306a-181b-4d3c-9450-451005f83bfe None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:50.829311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9306a-181b-4d3c-9450-451005f83bfe None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:50.830575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 504/992] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:01:50.835818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c7adc-4d5b-4ba4-ac90-28b6a592b6cf None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:50.836208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c7adc-4d5b-4ba4-ac90-28b6a592b6cf None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:50.836365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c7adc-4d5b-4ba4-ac90-28b6a592b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:50.901316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ae7c7adc-4d5b-4ba4-ac90-28b6a592b6cf None None] MFA Rules not processed for user `bcd9b59456f3476b9641e14cb5e4d2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:01:50.902534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ae7c7adc-4d5b-4ba4-ac90-28b6a592b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:50.952935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:50.996567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 489/993] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:01:51.279363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9306a-181b-4d3c-9450-451005f83bfe None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:01:51.280964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d1b9306a-181b-4d3c-9450-451005f83bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:51.291572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:51.387228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9306a-181b-4d3c-9450-451005f83bfe None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:01:51.459619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:01:51.460215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:51.460492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:51.460761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:51.462338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:51.522664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:51.569322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:01:51.570698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f80646-a6b2-48b0-aa8e-3ae7d09656ef service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:01:51.588208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 505/994] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:01:54.217024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84d62-c015-4219-a648-35706423d5d2 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:54.217598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84d62-c015-4219-a648-35706423d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:54.217598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84d62-c015-4219-a648-35706423d5d2 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:54.218960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 490/995] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:01:54.224233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b6eca-aaf9-40de-87f7-9e589f41bbec None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:54.224636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b6eca-aaf9-40de-87f7-9e589f41bbec None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:54.224777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b6eca-aaf9-40de-87f7-9e589f41bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:54.288866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6c5b6eca-aaf9-40de-87f7-9e589f41bbec None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:01:54.290061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6c5b6eca-aaf9-40de-87f7-9e589f41bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:54.383263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 506/996] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:01:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:01:54.671089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84d62-c015-4219-a648-35706423d5d2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:01:54.672652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f7f84d62-c015-4219-a648-35706423d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:54.773231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84d62-c015-4219-a648-35706423d5d2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:01:54.844661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:01:54.845254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:54.845531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:54.845799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:54.847368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:54.854020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:54.953525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:01:54.954897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a71b1-47cf-4f68-8106-a21c347f85ca service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:01:54.973562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 491/997] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:01:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:01:57.730793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7225a4-3f8e-494a-80fc-24e65b475cb5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:57.731254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7225a4-3f8e-494a-80fc-24e65b475cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:57.731369 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7225a4-3f8e-494a-80fc-24e65b475cb5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:57.732833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 507/998] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:01:57.738174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4916e-9c84-4081-87ca-bc392d62ce46 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:57.738547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4916e-9c84-4081-87ca-bc392d62ce46 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:57.738749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4916e-9c84-4081-87ca-bc392d62ce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:57.811707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-fcf4916e-9c84-4081-87ca-bc392d62ce46 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:01:57.812952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fcf4916e-9c84-4081-87ca-bc392d62ce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:57.877955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:57.920058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 492/999] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:01:58.200498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7225a4-3f8e-494a-80fc-24e65b475cb5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:01:58.202107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1a7225a4-3f8e-494a-80fc-24e65b475cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:58.222008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:58.303786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7225a4-3f8e-494a-80fc-24e65b475cb5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:01:58.378323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:01:58.378949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:01:58.379229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:01:58.379525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:01:58.381101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:01:58.453340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:01:58.492038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:01:58.493488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcab1d-dc78-471b-8e04-bb3cbdf242d6 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:01:58.512473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 508/1000] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:00.722815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa057a-7f9e-45fa-ba33-1995129d3590 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:00.723327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa057a-7f9e-45fa-ba33-1995129d3590 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:00.723430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa057a-7f9e-45fa-ba33-1995129d3590 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:00.724951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 493/1001] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:00.730623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af56f-5001-48bc-a818-03b4211a575e None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:00.731065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af56f-5001-48bc-a818-03b4211a575e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:00.731156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af56f-5001-48bc-a818-03b4211a575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:00.800398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a26af56f-5001-48bc-a818-03b4211a575e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:00.800398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a26af56f-5001-48bc-a818-03b4211a575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:00.900411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 509/1002] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:01.182938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa057a-7f9e-45fa-ba33-1995129d3590 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:01.184479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5faa057a-7f9e-45fa-ba33-1995129d3590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:01.287093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa057a-7f9e-45fa-ba33-1995129d3590 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:01.360556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:01.361152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:01.361431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:01.361695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:01.363269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:01.380751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:01.476691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:01.478050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fa9b0-792e-4b94-bc01-89c43a4c0ef1 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:01.497001 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 494/1003] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:02:03.692154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3afd7a-5481-4fd7-89ba-c39cc6c746d6 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:03.692632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3afd7a-5481-4fd7-89ba-c39cc6c746d6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:03.692632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3afd7a-5481-4fd7-89ba-c39cc6c746d6 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:03.693986 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 510/1004] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:03.699338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d4c8-8ecd-48ad-97c7-9b8d9ed7d3b8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:03.699767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d4c8-8ecd-48ad-97c7-9b8d9ed7d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:03.699923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d4c8-8ecd-48ad-97c7-9b8d9ed7d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:03.765326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-aeb9d4c8-8ecd-48ad-97c7-9b8d9ed7d3b8 None None] MFA Rules not processed for user `bcd9b59456f3476b9641e14cb5e4d2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:03.766517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-aeb9d4c8-8ecd-48ad-97c7-9b8d9ed7d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:03.832223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:03.867219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 495/1005] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:04.148346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3afd7a-5481-4fd7-89ba-c39cc6c746d6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:04.149874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4b3afd7a-5481-4fd7-89ba-c39cc6c746d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:04.185893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:04.261305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3afd7a-5481-4fd7-89ba-c39cc6c746d6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:04.335974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:04.336608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:04.336885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:04.337156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:04.339300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:04.418277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:04.450413 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:04.451913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7516a-d147-4a08-8d14-8afcc0c5b74f service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:04.470090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 511/1006] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:06.869908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142283fa-8d7e-477c-b68f-7f27e10b0d87 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:06.870490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142283fa-8d7e-477c-b68f-7f27e10b0d87 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:06.870490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142283fa-8d7e-477c-b68f-7f27e10b0d87 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:06.871872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 496/1007] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:06.877183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e1c4-b8db-4cba-8eeb-8e5b0db8db7f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:06.877607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e1c4-b8db-4cba-8eeb-8e5b0db8db7f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:06.877822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e1c4-b8db-4cba-8eeb-8e5b0db8db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:06.943027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-5c10e1c4-b8db-4cba-8eeb-8e5b0db8db7f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:06.944271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5c10e1c4-b8db-4cba-8eeb-8e5b0db8db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:07.039180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 512/1008] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:07.323746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142283fa-8d7e-477c-b68f-7f27e10b0d87 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:07.325274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-142283fa-8d7e-477c-b68f-7f27e10b0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:07.429465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142283fa-8d7e-477c-b68f-7f27e10b0d87 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:07.505584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:07.506197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:07.506481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:07.506757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:07.508412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:07.540369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:07.622827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:07.624290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22adebc-dbae-43d0-93c6-bda45a249d55 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:07.643179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 497/1009] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:09.825390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1392e-c0f7-4df5-a0ce-88fb75d8a092 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:09.825905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1392e-c0f7-4df5-a0ce-88fb75d8a092 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:09.826028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1392e-c0f7-4df5-a0ce-88fb75d8a092 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:09.827289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 513/1010] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:09.832511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4920-3f49-4d3e-b434-052aea7fc97d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:09.832942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4920-3f49-4d3e-b434-052aea7fc97d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:09.833095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4920-3f49-4d3e-b434-052aea7fc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:09.897011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0d2b4920-3f49-4d3e-b434-052aea7fc97d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:09.898210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0d2b4920-3f49-4d3e-b434-052aea7fc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:09.970553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:09.992345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 498/1011] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:10.274437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1392e-c0f7-4df5-a0ce-88fb75d8a092 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:10.275991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-64c1392e-c0f7-4df5-a0ce-88fb75d8a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:10.315980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:10.377605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1392e-c0f7-4df5-a0ce-88fb75d8a092 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:10.447731 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:10.448348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:10.448623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:10.448892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:10.450445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:10.530770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:10.555853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:10.557273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6118581-b18a-4b52-88b0-ff8824aca730 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:10.575340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 514/1012] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:13.036235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c923-511a-4da1-ba19-b45b3f700616 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:13.036790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c923-511a-4da1-ba19-b45b3f700616 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:13.036790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c923-511a-4da1-ba19-b45b3f700616 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:13.038030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 499/1013] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:13.043178 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eab63-56ec-4db1-9f70-e266c3733841 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:13.043628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eab63-56ec-4db1-9f70-e266c3733841 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:13.043775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eab63-56ec-4db1-9f70-e266c3733841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:13.108709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-836eab63-56ec-4db1-9f70-e266c3733841 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:13.109920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-836eab63-56ec-4db1-9f70-e266c3733841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:13.204236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 515/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:13.491060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c923-511a-4da1-ba19-b45b3f700616 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:13.493070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-dda3c923-511a-4da1-ba19-b45b3f700616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:13.593407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c923-511a-4da1-ba19-b45b3f700616 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:13.664979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:13.665568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:13.665860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:13.666105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:13.668263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:13.703386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:13.776710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:13.778095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d787b-987e-4e2c-b573-50738e9f00b7 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:13.795790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 500/1015] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:17.775606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a20a-b580-4192-bebd-bbdb3e24d0b5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:17.776138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a20a-b580-4192-bebd-bbdb3e24d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:17.776138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a20a-b580-4192-bebd-bbdb3e24d0b5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:17.777529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 516/1016] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:17.782657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e658-585a-453d-a8ff-abb84a239cbb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:17.783061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e658-585a-453d-a8ff-abb84a239cbb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:17.783199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e658-585a-453d-a8ff-abb84a239cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:17.848255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4b96e658-585a-453d-a8ff-abb84a239cbb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:17.849470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4b96e658-585a-453d-a8ff-abb84a239cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:17.934110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:17.946030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 501/1017] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:18.224791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a20a-b580-4192-bebd-bbdb3e24d0b5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:18.226431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-04a7a20a-b580-4192-bebd-bbdb3e24d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:18.277448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:18.331955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a20a-b580-4192-bebd-bbdb3e24d0b5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:18.406602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:18.407209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:18.407518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:18.407792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:18.409382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:18.504746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:18.522803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:18.524307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f871-2b6a-45b9-8c59-88bc092513c0 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:18.543910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 517/1018] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:21.343155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f65ee-753b-43ca-a2b4-7f404d3a3608 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:21.343711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f65ee-753b-43ca-a2b4-7f404d3a3608 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:21.343711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f65ee-753b-43ca-a2b4-7f404d3a3608 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:21.345067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 502/1019] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:21.350304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7639-cf31-44e8-979b-92dd29c31b5b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:21.350726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7639-cf31-44e8-979b-92dd29c31b5b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:21.350852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7639-cf31-44e8-979b-92dd29c31b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:21.415770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-82ca7639-cf31-44e8-979b-92dd29c31b5b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:21.416993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-82ca7639-cf31-44e8-979b-92dd29c31b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:21.529970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 518/1020] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:21.811631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f65ee-753b-43ca-a2b4-7f404d3a3608 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:21.813300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ca0f65ee-753b-43ca-a2b4-7f404d3a3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:21.921484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f65ee-753b-43ca-a2b4-7f404d3a3608 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:21.995279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:21.996052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:21.996371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:21.996645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:21.998279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:22.041874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:22.109757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:22.111204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e10559-b44b-48b7-bc00-5cb1028542e0 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:22.129395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 503/1021] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:26.221688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6ffa5-f054-45ce-b9a7-b6a3db3a174f None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:26.222211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6ffa5-f054-45ce-b9a7-b6a3db3a174f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:26.222300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6ffa5-f054-45ce-b9a7-b6a3db3a174f None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:26.223607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 519/1022] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:02:26.229036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2b941-92f6-4e62-ad73-b6c828d1592f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:26.229776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2b941-92f6-4e62-ad73-b6c828d1592f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:26.230054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2b941-92f6-4e62-ad73-b6c828d1592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:26.303852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5de2b941-92f6-4e62-ad73-b6c828d1592f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:26.305064 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5de2b941-92f6-4e62-ad73-b6c828d1592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:26.398491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:26.400888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 504/1023] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:26.685202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6ffa5-f054-45ce-b9a7-b6a3db3a174f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:26.686731 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9fa6ffa5-f054-45ce-b9a7-b6a3db3a174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:26.744200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:26.789545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6ffa5-f054-45ce-b9a7-b6a3db3a174f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:26.862085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:26.862689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:26.862966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:26.863235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:26.864847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:26.971181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:26.976214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:26.977832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ba930-2951-4c97-9b3f-5653d298de90 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:26.996097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 520/1024] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:31.912803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178a1c-3772-4132-a4a6-005be07961e1 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:31.913328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178a1c-3772-4132-a4a6-005be07961e1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:31.913591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178a1c-3772-4132-a4a6-005be07961e1 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:31.915208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 505/1025] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:31.921443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4f3d-6945-426c-81b9-cf09f55eba3d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:31.922483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4f3d-6945-426c-81b9-cf09f55eba3d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:31.922899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4f3d-6945-426c-81b9-cf09f55eba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:32.011473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d2be4f3d-6945-426c-81b9-cf09f55eba3d None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:32.013520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d2be4f3d-6945-426c-81b9-cf09f55eba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:32.213272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 521/1026] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:36.367229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be1e9-4777-481f-8900-702fe889b2ff None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:36.368288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be1e9-4777-481f-8900-702fe889b2ff None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:36.368695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be1e9-4777-481f-8900-702fe889b2ff None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:36.370621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 506/1027] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:36.375809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656b0e-a41e-4888-8391-c12195e89fa4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:36.376261 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656b0e-a41e-4888-8391-c12195e89fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:36.376585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656b0e-a41e-4888-8391-c12195e89fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:36.432313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:36.457826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-8b656b0e-a41e-4888-8391-c12195e89fa4 None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:36.459192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8b656b0e-a41e-4888-8391-c12195e89fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:36.577727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 522/1028] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:37.759366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd4e8-afdc-40c1-a3bb-4e5ea720f8d9 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:37.759913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd4e8-afdc-40c1-a3bb-4e5ea720f8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:37.759913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd4e8-afdc-40c1-a3bb-4e5ea720f8d9 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:37.761275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 507/1029] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:37.766763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd10b1-c2c4-488b-8b52-5cd10ae3d7f0 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:37.767242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd10b1-c2c4-488b-8b52-5cd10ae3d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:37.767613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd10b1-c2c4-488b-8b52-5cd10ae3d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:37.844295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-66dd10b1-c2c4-488b-8b52-5cd10ae3d7f0 None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:37.845501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-66dd10b1-c2c4-488b-8b52-5cd10ae3d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:37.888341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:37.953750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 523/1030] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:41.574518 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e23834-ad05-4716-bd6f-1af027b6904e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:41.575065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e23834-ad05-4716-bd6f-1af027b6904e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:41.575311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e23834-ad05-4716-bd6f-1af027b6904e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:41.576847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 508/1031] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:41.582430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbfaf7-11aa-462e-a9cf-df6eafd993b3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:41.583218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbfaf7-11aa-462e-a9cf-df6eafd993b3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:41.583578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbfaf7-11aa-462e-a9cf-df6eafd993b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:41.656588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-12dbfaf7-11aa-462e-a9cf-df6eafd993b3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:41.657953 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-12dbfaf7-11aa-462e-a9cf-df6eafd993b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:41.769757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 524/1032] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:42.083293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14ffc-a736-4c66-b02b-24e28b4578a5 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:42.083605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14ffc-a736-4c66-b02b-24e28b4578a5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:42.083878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14ffc-a736-4c66-b02b-24e28b4578a5 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:42.085382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 509/1033] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 13:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:42.094034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a509b5-1377-423d-8110-0b8a3aedc1d7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:42.094650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a509b5-1377-423d-8110-0b8a3aedc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:42.095074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a509b5-1377-423d-8110-0b8a3aedc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:42.113524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:42.186931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-32a509b5-1377-423d-8110-0b8a3aedc1d7 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:42.188166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-32a509b5-1377-423d-8110-0b8a3aedc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:42.313074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 525/1034] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:42.321190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad14ffc-a736-4c66-b02b-24e28b4578a5 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:42.322681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-dad14ffc-a736-4c66-b02b-24e28b4578a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:42.475811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad14ffc-a736-4c66-b02b-24e28b4578a5 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:42.551937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:42.594180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:42.594856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:42.595066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:42.595311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:42.596904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:42.700280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:42.702102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cf6fa-6eb8-47d2-b7e5-9b4a507dd54a service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:42.733047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 510/1035] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:02:45.106895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbc88-70d3-4381-87cc-19b6440d13ab None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:45.108247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbc88-70d3-4381-87cc-19b6440d13ab None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:45.108247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbc88-70d3-4381-87cc-19b6440d13ab None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:45.119632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f8fb9-1678-4cfe-a693-3977dd8cc371 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:45.120111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f8fb9-1678-4cfe-a693-3977dd8cc371 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:45.120955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f8fb9-1678-4cfe-a693-3977dd8cc371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:45.126254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 526/1036] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:45 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:45.194198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-fd8f8fb9-1678-4cfe-a693-3977dd8cc371 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:45.195601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fd8f8fb9-1678-4cfe-a693-3977dd8cc371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:45.237657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:45.305467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 511/1037] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:45.595595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbc88-70d3-4381-87cc-19b6440d13ab None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:45.597109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-89ecbc88-70d3-4381-87cc-19b6440d13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:45.675957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:45.798448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbc88-70d3-4381-87cc-19b6440d13ab None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:45.943254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:45.943805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:45.944088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:45.944356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:45.945949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:45.968983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:46.037424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:46.039024 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a150b36-5314-4d90-a81a-e62a9e68a656 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:46.058553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 527/1038] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:48.541359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e15db-bfef-4237-bc6c-79b2601ecc2c None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:48.541858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e15db-bfef-4237-bc6c-79b2601ecc2c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:48.541858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e15db-bfef-4237-bc6c-79b2601ecc2c None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:48.543172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 512/1039] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:48.549016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865704d8-d32d-43ea-8e22-db8623f45bd1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:48.549442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865704d8-d32d-43ea-8e22-db8623f45bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:48.549647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865704d8-d32d-43ea-8e22-db8623f45bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:48.618237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-865704d8-d32d-43ea-8e22-db8623f45bd1 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:48.619472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-865704d8-d32d-43ea-8e22-db8623f45bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:48.721358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:48.732096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 528/1040] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:49.013054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ff5c-7811-43f9-a30a-7644d63540e3 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:49.013451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ff5c-7811-43f9-a30a-7644d63540e3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:49.013923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ff5c-7811-43f9-a30a-7644d63540e3 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:49.015630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 513/1041] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 13:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:49.020799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea4c6-226d-4373-be57-6bc35d356e4e None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:49.021083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea4c6-226d-4373-be57-6bc35d356e4e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:49.021356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ea4c6-226d-4373-be57-6bc35d356e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:49.099665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-356ea4c6-226d-4373-be57-6bc35d356e4e None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:49.100878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-356ea4c6-226d-4373-be57-6bc35d356e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:49.222376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 529/1042] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 13:02:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:49.229974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ff5c-7811-43f9-a30a-7644d63540e3 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:49.232052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7d54ff5c-7811-43f9-a30a-7644d63540e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:49.384491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ff5c-7811-43f9-a30a-7644d63540e3 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:49.406507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:49.509300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:49.510027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:49.510376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:49.510721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:49.512957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:49.609888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:49.611681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42fe3e-588b-4a03-a559-83ed406179da service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:49.634476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 514/1043] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:49.728588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280a53-cc26-4127-ade6-7980e6f3f324 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:49.729116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280a53-cc26-4127-ade6-7980e6f3f324 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:49.729227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280a53-cc26-4127-ade6-7980e6f3f324 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:49.743688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e2ce6-9b73-4deb-8dde-5ac82dd6a279 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:49.743688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e2ce6-9b73-4deb-8dde-5ac82dd6a279 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:49.743688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e2ce6-9b73-4deb-8dde-5ac82dd6a279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:49.743992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 530/1044] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:49.773113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:49.820793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a76e2ce6-9b73-4deb-8dde-5ac82dd6a279 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:49.822369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a76e2ce6-9b73-4deb-8dde-5ac82dd6a279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:49.945305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 515/1045] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:02:50.243710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b762-5cae-47d3-9a26-bcb5e548eba6 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:50.244001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b762-5cae-47d3-9a26-bcb5e548eba6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:50.244280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b762-5cae-47d3-9a26-bcb5e548eba6 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:50.245620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 531/1046] 10.222.0.25 () {54 vars in 963 bytes} [Thu Oct 13 13:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:50.250583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cdd22-c7be-478f-992c-7c7b66afa5b3 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:50.250939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cdd22-c7be-478f-992c-7c7b66afa5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:50.251313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cdd22-c7be-478f-992c-7c7b66afa5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:50.336918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-512cdd22-c7be-478f-992c-7c7b66afa5b3 None None] MFA Rules not processed for user `a96fabf57bae435eaf4b6c61cbb89346`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:50.338174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-512cdd22-c7be-478f-992c-7c7b66afa5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:50.389087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:50.422562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 516/1047] 10.222.0.25 () {58 vars in 1060 bytes} [Thu Oct 13 13:02:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:50.430016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6b762-5cae-47d3-9a26-bcb5e548eba6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:50.431735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e0f6b762-5cae-47d3-9a26-bcb5e548eba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:50.487247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:50.544629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6b762-5cae-47d3-9a26-bcb5e548eba6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:50.629435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:50.630020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:50.630296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:50.630564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:50.632165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:50.743729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:50.759599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:50.761042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21224272-8d1b-4020-81ce-d60096dca042 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:50.782502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 532/1048] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:51.864384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c9f3-9105-46a1-b8a2-33bfb9ec075b None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:51.864916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c9f3-9105-46a1-b8a2-33bfb9ec075b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:51.865008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c9f3-9105-46a1-b8a2-33bfb9ec075b None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:51.866322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 517/1049] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:02:51.871566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be771-9c06-4563-8625-a151eb7adb6d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:51.872021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be771-9c06-4563-8625-a151eb7adb6d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:51.872132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be771-9c06-4563-8625-a151eb7adb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:51.935828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-185be771-9c06-4563-8625-a151eb7adb6d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:51.937027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-185be771-9c06-4563-8625-a151eb7adb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:52.034355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 533/1050] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:52.326987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c9f3-9105-46a1-b8a2-33bfb9ec075b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:52.328590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f065c9f3-9105-46a1-b8a2-33bfb9ec075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:52.490088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c9f3-9105-46a1-b8a2-33bfb9ec075b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:52.544048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:52.608009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:52.608619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:52.609178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:52.609178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:52.610753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:52.703830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:52.705451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce83c-1165-4d48-a0c9-de7f237fa20b service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:52.729314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 518/1051] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:54.943508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8413-9054-4016-a930-21a861034d24 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:54.944065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8413-9054-4016-a930-21a861034d24 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:54.944308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8413-9054-4016-a930-21a861034d24 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:54.945743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 534/1052] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:54.951542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35fb9-00f8-49a9-acd9-c5098114d93f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:54.951950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35fb9-00f8-49a9-acd9-c5098114d93f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:54.952135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35fb9-00f8-49a9-acd9-c5098114d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:55.019653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-82b35fb9-00f8-49a9-acd9-c5098114d93f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:55.020770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-82b35fb9-00f8-49a9-acd9-c5098114d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:55.027860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:55.126299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 519/1053] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:55.411888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8413-9054-4016-a930-21a861034d24 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:55.413720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-997c8413-9054-4016-a930-21a861034d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:55.482396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:55.575478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8413-9054-4016-a930-21a861034d24 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:55.699155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:55.699722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:55.700005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:55.700334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:55.701922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:55.726871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:55.804723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:55.806453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3a707-d8c9-4345-b688-7cfb514c5858 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:55.827932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 535/1054] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:02:58.020512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588b12-ba29-41c6-87d9-0ccf30a63ee8 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:58.021130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588b12-ba29-41c6-87d9-0ccf30a63ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:58.021130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588b12-ba29-41c6-87d9-0ccf30a63ee8 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:58.022505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 520/1055] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:02:58.027556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee23254-0102-4115-85f3-69cb12734e32 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:58.027953 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee23254-0102-4115-85f3-69cb12734e32 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:58.028157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee23254-0102-4115-85f3-69cb12734e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:58.099124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-dee23254-0102-4115-85f3-69cb12734e32 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:02:58.100752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-dee23254-0102-4115-85f3-69cb12734e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:58.203949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:58.229311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 536/1056] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:02:58.504893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40588b12-ba29-41c6-87d9-0ccf30a63ee8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:02:58.506407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-40588b12-ba29-41c6-87d9-0ccf30a63ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:58.654954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:58.668223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40588b12-ba29-41c6-87d9-0ccf30a63ee8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:02:58.795351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:02:58.795979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:02:58.796252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:02:58.796544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:02:58.798129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:02:58.891036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:02:58.893229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558f63-5f19-45ee-a053-79e316729ace service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:02:58.905937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:58.914788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 521/1057] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:01.099542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4f04-453a-4631-9590-291413179df2 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:01.100128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4f04-453a-4631-9590-291413179df2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:01.100128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4f04-453a-4631-9590-291413179df2 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:01.101418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 537/1058] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:01.107014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17561-d875-4d55-b1bb-92a552f9f958 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:01.107531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17561-d875-4d55-b1bb-92a552f9f958 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:01.107667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17561-d875-4d55-b1bb-92a552f9f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:01.179619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-99c17561-d875-4d55-b1bb-92a552f9f958 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:01.181483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-99c17561-d875-4d55-b1bb-92a552f9f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:01.281895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 522/1059] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:01.593471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4f04-453a-4631-9590-291413179df2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:01.595312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6dec4f04-453a-4631-9590-291413179df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:01.763569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4f04-453a-4631-9590-291413179df2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:01.832522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:01.880290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:01.880905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:01.881183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:01.881454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:01.883062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:01.972464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:01.974061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbba03-bc5e-408d-baf7-421d471c1248 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:01.992219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 538/1060] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:04.148557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6357a6-a87f-4edd-bdc9-85dfffb763b0 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:04.149092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6357a6-a87f-4edd-bdc9-85dfffb763b0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:04.149092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6357a6-a87f-4edd-bdc9-85dfffb763b0 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:04.150494 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 523/1061] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:04.156063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688272-2043-4448-9e0a-8177d3bd0c1b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:04.156465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688272-2043-4448-9e0a-8177d3bd0c1b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:04.156746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688272-2043-4448-9e0a-8177d3bd0c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:04.235682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-0e688272-2043-4448-9e0a-8177d3bd0c1b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:04.237217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0e688272-2043-4448-9e0a-8177d3bd0c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:04.275932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:04.350287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 539/1062] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:04.637778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6357a6-a87f-4edd-bdc9-85dfffb763b0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:04.639354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9c6357a6-a87f-4edd-bdc9-85dfffb763b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:04.731429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:04.803057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6357a6-a87f-4edd-bdc9-85dfffb763b0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:04.921571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:04.922096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:04.922373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:04.922639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:04.924287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:04.974888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:05.035343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:05.036983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e74fb9-a391-4990-911a-5a134a3415f7 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:05.058875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 524/1063] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:03:07.264789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adce0b-e8e1-433d-9618-ec43325a46d6 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:07.265296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adce0b-e8e1-433d-9618-ec43325a46d6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:07.265401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adce0b-e8e1-433d-9618-ec43325a46d6 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:07.266706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 540/1064] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:07.272057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f36586-88ea-4e3c-9121-46a0a2d04f3e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:07.272497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f36586-88ea-4e3c-9121-46a0a2d04f3e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:07.272589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f36586-88ea-4e3c-9121-46a0a2d04f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:07.337427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c3f36586-88ea-4e3c-9121-46a0a2d04f3e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:07.338627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c3f36586-88ea-4e3c-9121-46a0a2d04f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:07.432034 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 525/1065] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:07.725768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adce0b-e8e1-433d-9618-ec43325a46d6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:07.727350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f4adce0b-e8e1-433d-9618-ec43325a46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:07.873471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adce0b-e8e1-433d-9618-ec43325a46d6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:07.889425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:07.984500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:07.985011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:07.985291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:07.985552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:07.987112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:08.075062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:08.077205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba413d0-6b09-4b35-9ae4-28995fcf7a8f service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:08.098077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 541/1066] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:08.207545 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78ad0-d094-4045-a1f1-78dc53cb25eb None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:08.207838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78ad0-d094-4045-a1f1-78dc53cb25eb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:08.208106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78ad0-d094-4045-a1f1-78dc53cb25eb None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:08.209687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 526/1067] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:08.215487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956b65-ce9a-494a-a26b-2ea4dee7cef2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:08.215772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956b65-ce9a-494a-a26b-2ea4dee7cef2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:08.216046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956b65-ce9a-494a-a26b-2ea4dee7cef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:08.244269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:08.291733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-78956b65-ce9a-494a-a26b-2ea4dee7cef2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:08.292965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-78956b65-ce9a-494a-a26b-2ea4dee7cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:08.392016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 542/1068] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:08.692931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae478-6d76-4007-a68c-aec3f254cf8e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:08.693415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae478-6d76-4007-a68c-aec3f254cf8e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:08.693602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae478-6d76-4007-a68c-aec3f254cf8e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:08.695251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 527/1069] 10.222.0.25 () {54 vars in 962 bytes} [Thu Oct 13 13:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:03:08.700624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560213dd-ad03-4478-b05b-44e5cd2b4d44 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:08.701463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560213dd-ad03-4478-b05b-44e5cd2b4d44 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:08.701836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560213dd-ad03-4478-b05b-44e5cd2b4d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:08.780527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-560213dd-ad03-4478-b05b-44e5cd2b4d44 None None] MFA Rules not processed for user `5fc9d2d85fbd449c86ea50f1d46ce009`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:08.781722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-560213dd-ad03-4478-b05b-44e5cd2b4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:08.822666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:08.860290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 543/1070] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Oct 13 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:08.869353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbae478-6d76-4007-a68c-aec3f254cf8e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:08.870879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5dbae478-6d76-4007-a68c-aec3f254cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:08.885489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:08.976370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbae478-6d76-4007-a68c-aec3f254cf8e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:09.052036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:09.052643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:09.052918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:09.053189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:09.054771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:09.122259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:09.163110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:09.164585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c933bc-8999-408a-9855-f1fe363135f5 service glance] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:09.185099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 528/1071] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:09.910350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c0a0-2729-4d5b-8cc9-58da923c7170 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:09.910848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c0a0-2729-4d5b-8cc9-58da923c7170 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:09.910959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c0a0-2729-4d5b-8cc9-58da923c7170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:09.976253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-78d7c0a0-2729-4d5b-8cc9-58da923c7170 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:09.977468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-78d7c0a0-2729-4d5b-8cc9-58da923c7170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:10.062588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 544/1072] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:03:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:10.105219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26142e-2df6-43ba-b6cd-b0c783d1f6aa None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:10.105691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26142e-2df6-43ba-b6cd-b0c783d1f6aa None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:10.105986 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26142e-2df6-43ba-b6cd-b0c783d1f6aa None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:10.108200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 529/1073] 10.222.0.25 () {54 vars in 943 bytes} [Thu Oct 13 13:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:10.114597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:10.114890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:10.115165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:10.186086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:10.196539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] MFA Rules not processed for user `62bb121942c94956b40024757f89a5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:10.197837 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:10.294589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be1d26-d45e-48fb-b1b9-2eb45ca93a16 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:10.294869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be1d26-d45e-48fb-b1b9-2eb45ca93a16 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:10.295151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be1d26-d45e-48fb-b1b9-2eb45ca93a16 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:10.296532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 530/1074] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:10.301492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:10.301775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:10.302053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:10.307727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 545/1075] 10.222.0.25 () {58 vars in 1040 bytes} [Thu Oct 13 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:10.316808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:10.327355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333f947-03ef-43b7-b051-5b006e84deaf None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:10.368984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:10.370504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:10.432126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:10.432755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:10.433030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:10.433300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:10.434914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:10.437460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:10.468859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 531/1076] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:03:10.520907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:10.522497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626ab5c-1a1f-4bcb-b3e5-18aac2234051 service swift] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:10.531060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 546/1077] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:03:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 13:03:10.764079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:10.765292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:10.795256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:10.895274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a208e1-a9bc-4d12-b4da-0dde73f406b6 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:11.026826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:11.027568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:11.027854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:11.028126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:11.029736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:11.053359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:11.135955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:11.137583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c03a2-9001-4720-8f85-dc8db327585b service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:11.157605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 532/1078] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:13.416169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc31ba-920a-4c98-a8cd-c4686f4effe9 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:13.416758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc31ba-920a-4c98-a8cd-c4686f4effe9 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:13.416758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc31ba-920a-4c98-a8cd-c4686f4effe9 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:13.418145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 547/1079] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:13.424112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c51ed-b76a-44a5-9dbd-3f5a3ecfa22b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:13.424544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c51ed-b76a-44a5-9dbd-3f5a3ecfa22b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:13.424634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c51ed-b76a-44a5-9dbd-3f5a3ecfa22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:13.494803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-387c51ed-b76a-44a5-9dbd-3f5a3ecfa22b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:13.496050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-387c51ed-b76a-44a5-9dbd-3f5a3ecfa22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:13.595116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:13.607618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 533/1080] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:13.892344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc31ba-920a-4c98-a8cd-c4686f4effe9 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:13.893883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-56cc31ba-920a-4c98-a8cd-c4686f4effe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:14.051082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:14.053635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc31ba-920a-4c98-a8cd-c4686f4effe9 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:14.178467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:14.179086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:14.179351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:14.179678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:14.181231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:14.286232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:14.287912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bac3f-7332-44af-8cde-eda34d645f34 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:14.306892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 548/1081] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:16.539345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657e65-b58c-4dba-b862-b217cc211725 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:16.539934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657e65-b58c-4dba-b862-b217cc211725 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:16.539934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657e65-b58c-4dba-b862-b217cc211725 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:16.541282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 534/1082] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:16.549843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f72f-cb4f-409b-96c5-ac153a0b981c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:16.549843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f72f-cb4f-409b-96c5-ac153a0b981c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:16.549843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f72f-cb4f-409b-96c5-ac153a0b981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:16.555846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:16.659929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6eb6f72f-cb4f-409b-96c5-ac153a0b981c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:16.659929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6eb6f72f-cb4f-409b-96c5-ac153a0b981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:16.811546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 549/1083] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:17.092848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f657e65-b58c-4dba-b862-b217cc211725 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:17.094411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2f657e65-b58c-4dba-b862-b217cc211725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:17.261698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f657e65-b58c-4dba-b862-b217cc211725 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:17.338759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:17.390917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:17.391551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:17.391824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:17.392092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:17.393672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:17.494172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:17.496397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f7c88-70e3-42f2-a47d-bb0cd095f5ff service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:17.517225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 535/1084] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:26.801473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=64 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:27.513675 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=64 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:33.285591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefb8d-228b-40de-afc2-35dbef565d1b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:33.286059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefb8d-228b-40de-afc2-35dbef565d1b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:33.286162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefb8d-228b-40de-afc2-35dbef565d1b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:33.287501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 550/1085] 10.222.0.25 () {54 vars in 918 bytes} [Thu Oct 13 13:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:33.292700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed97f-acba-43ad-997d-c55781cc076a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:33.293096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed97f-acba-43ad-997d-c55781cc076a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:33.293246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed97f-acba-43ad-997d-c55781cc076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:33.369522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ef0ed97f-acba-43ad-997d-c55781cc076a None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:33.370725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ef0ed97f-acba-43ad-997d-c55781cc076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:33.483730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 536/1086] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Oct 13 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:33.500651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffbb34-30b6-482f-ad08-1d02b36156b5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:33.500929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffbb34-30b6-482f-ad08-1d02b36156b5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:33.501200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffbb34-30b6-482f-ad08-1d02b36156b5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:33.502517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 551/1087] 10.222.0.25 () {54 vars in 918 bytes} [Thu Oct 13 13:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:33.507758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26122-0e73-46b0-8a8f-9667aee315f4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:33.508043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26122-0e73-46b0-8a8f-9667aee315f4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:33.508322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26122-0e73-46b0-8a8f-9667aee315f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:33.580583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:33.583297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-35c26122-0e73-46b0-8a8f-9667aee315f4 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:33.585148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-35c26122-0e73-46b0-8a8f-9667aee315f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:33.700037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 537/1088] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Oct 13 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:36.229971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eb1a-2cfe-4f34-9624-86ab4b7b671a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:36.230543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eb1a-2cfe-4f34-9624-86ab4b7b671a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:36.230543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eb1a-2cfe-4f34-9624-86ab4b7b671a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:36.231857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 552/1089] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:36.237029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe9fd3-6c35-47a4-bc11-4e204925da35 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:36.237487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe9fd3-6c35-47a4-bc11-4e204925da35 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:36.237621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe9fd3-6c35-47a4-bc11-4e204925da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:36.302295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e8fe9fd3-6c35-47a4-bc11-4e204925da35 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:36.303654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e8fe9fd3-6c35-47a4-bc11-4e204925da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:36.357466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:36.399644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 538/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:36.685663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eb1a-2cfe-4f34-9624-86ab4b7b671a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:36.687765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4a76eb1a-2cfe-4f34-9624-86ab4b7b671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:36.832807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eb1a-2cfe-4f34-9624-86ab4b7b671a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:36.903761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:36.943237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:36.943825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:36.944104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:36.944374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:36.946216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:37.033113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:37.034697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abf8d5-1676-493b-b086-7138eb5c408c service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:37.052142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 553/1091] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:38.172259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cae0f9-1c6f-42fc-80b7-3decd5bf16ba None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:38.172828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cae0f9-1c6f-42fc-80b7-3decd5bf16ba None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:38.173077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cae0f9-1c6f-42fc-80b7-3decd5bf16ba None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:38.174561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 539/1092] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:38.180918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d6581-ff3d-40e4-86d0-2a1409bda8fc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:38.181356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d6581-ff3d-40e4-86d0-2a1409bda8fc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:38.181469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d6581-ff3d-40e4-86d0-2a1409bda8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:38.256306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-de0d6581-ff3d-40e4-86d0-2a1409bda8fc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:38.257497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-de0d6581-ff3d-40e4-86d0-2a1409bda8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:38.283556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:38.351483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 554/1093] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:03:38.499728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cae0f9-1c6f-42fc-80b7-3decd5bf16ba None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:38.501157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-90cae0f9-1c6f-42fc-80b7-3decd5bf16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:38.642052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cae0f9-1c6f-42fc-80b7-3decd5bf16ba None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:38.681698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:38.754285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:38.754809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:38.755086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:38.755363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:38.756971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:38.845819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:38.847425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab9a5e-40c1-44fd-9067-a4aeae42a1a2 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:38.864508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 540/1094] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:39.984077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e395d-9af6-447f-878d-cef00938bba2 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:39.984609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e395d-9af6-447f-878d-cef00938bba2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:39.984609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e395d-9af6-447f-878d-cef00938bba2 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:39.985865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 555/1095] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:39.992234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4200e6-d3cb-4784-be17-a7a0d568ee6c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:39.992682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4200e6-d3cb-4784-be17-a7a0d568ee6c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:39.992789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4200e6-d3cb-4784-be17-a7a0d568ee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:40.045353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:40.067787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ab4200e6-d3cb-4784-be17-a7a0d568ee6c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:40.068992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ab4200e6-d3cb-4784-be17-a7a0d568ee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:40.163219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 541/1096] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:40.313085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e395d-9af6-447f-878d-cef00938bba2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:40.314519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a27e395d-9af6-447f-878d-cef00938bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:40.455828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e395d-9af6-447f-878d-cef00938bba2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:40.467552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:40.564599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:40.565124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:40.565398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:40.565667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:40.567236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:40.657950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:40.659771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725d287-16e7-45e8-90c4-e3c49ce77bfd service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:40.677821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 556/1097] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:41.778882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f470a7-3e03-4ec1-8ebc-e80110a614c1 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:41.779308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f470a7-3e03-4ec1-8ebc-e80110a614c1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:41.779449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f470a7-3e03-4ec1-8ebc-e80110a614c1 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:41.780859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 542/1098] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:41.787134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e386-7e50-4440-937b-282757224711 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:41.787685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e386-7e50-4440-937b-282757224711 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:41.787685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e386-7e50-4440-937b-282757224711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:41.807322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:41.863518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-69d1e386-7e50-4440-937b-282757224711 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:41.864713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-69d1e386-7e50-4440-937b-282757224711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:41.956426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 557/1099] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:42.103990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f470a7-3e03-4ec1-8ebc-e80110a614c1 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:42.105537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-66f470a7-3e03-4ec1-8ebc-e80110a614c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:42.215051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:42.252335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f470a7-3e03-4ec1-8ebc-e80110a614c1 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:42.363250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:42.363817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:42.364098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:42.364370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:42.365970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:42.441019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:42.455650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:42.457241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864537aa-9cd3-4c23-adc3-62b877f9cc6d service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:42.475074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 543/1100] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:43.576962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc25045-b303-427f-a9a7-e87f32cc2ef1 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:43.577538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc25045-b303-427f-a9a7-e87f32cc2ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:43.577538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc25045-b303-427f-a9a7-e87f32cc2ef1 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:43.578848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 558/1101] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:43.585064 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcac9da-3dba-4613-9bfb-809f0ed7debc None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:43.585539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcac9da-3dba-4613-9bfb-809f0ed7debc None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:43.585643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcac9da-3dba-4613-9bfb-809f0ed7debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:43.659783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-fdcac9da-3dba-4613-9bfb-809f0ed7debc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:43.660984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fdcac9da-3dba-4613-9bfb-809f0ed7debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:43.756718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 544/1102] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:43.905700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc25045-b303-427f-a9a7-e87f32cc2ef1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:43.907148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5dc25045-b303-427f-a9a7-e87f32cc2ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:43.990674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:44.051799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc25045-b303-427f-a9a7-e87f32cc2ef1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:44.164080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:44.164623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:44.164900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:44.165172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:44.166752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:44.215308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:44.257848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:44.259483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724e1ec-f449-4026-89a8-4ca0ad1719ec service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:44.277334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 559/1103] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:45.326298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5da6b-da16-466d-baa8-4db6f6cf7a08 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:45.326807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5da6b-da16-466d-baa8-4db6f6cf7a08 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:45.326903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5da6b-da16-466d-baa8-4db6f6cf7a08 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:45.328893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 545/1104] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:45.335192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41ff6-7439-4fd1-9d5f-761ef8dca1a4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:45.335668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41ff6-7439-4fd1-9d5f-761ef8dca1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:45.335770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41ff6-7439-4fd1-9d5f-761ef8dca1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:45.410177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ebb41ff6-7439-4fd1-9d5f-761ef8dca1a4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:45.411371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ebb41ff6-7439-4fd1-9d5f-761ef8dca1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:45.506666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 560/1105] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:45.664874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5da6b-da16-466d-baa8-4db6f6cf7a08 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:45.666534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7af5da6b-da16-466d-baa8-4db6f6cf7a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:45.717999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:45.818828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5da6b-da16-466d-baa8-4db6f6cf7a08 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:45.928895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:45.929493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:45.929795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:45.930065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:45.931672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:45.938870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:46.020638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:46.022218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af6761-d33a-4884-8bc4-47a84f273298 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:46.039848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 546/1106] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:47.093744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663824c0-6027-48f5-a2b4-43deca7f4d0b None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:47.094308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663824c0-6027-48f5-a2b4-43deca7f4d0b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:47.094308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663824c0-6027-48f5-a2b4-43deca7f4d0b None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:47.095679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 561/1107] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:47.101789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d98d-2d3e-477a-8550-979755853d2c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:47.102236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d98d-2d3e-477a-8550-979755853d2c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:47.102339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d98d-2d3e-477a-8550-979755853d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:47.177956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-7ac1d98d-2d3e-477a-8550-979755853d2c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:47.179155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7ac1d98d-2d3e-477a-8550-979755853d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:47.245939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:47.274761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 547/1108] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:47.422889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663824c0-6027-48f5-a2b4-43deca7f4d0b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:47.424339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-663824c0-6027-48f5-a2b4-43deca7f4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:47.442126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:47.568323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663824c0-6027-48f5-a2b4-43deca7f4d0b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:47.653829 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:47.678982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:47.679566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:47.679848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:47.680119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:47.681703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:47.777023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:47.778617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4cd9-d8ca-47f0-af3f-b4ff3e05a141 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:47.795848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 562/1109] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:48.846149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59e6e-9122-4e7e-9cd7-bd59702f5846 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:48.846679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59e6e-9122-4e7e-9cd7-bd59702f5846 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:48.846679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59e6e-9122-4e7e-9cd7-bd59702f5846 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:48.848095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 548/1110] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:48.854352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af878ec9-9714-43c2-8eee-b78ea59e77c2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:48.854779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af878ec9-9714-43c2-8eee-b78ea59e77c2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:48.854887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af878ec9-9714-43c2-8eee-b78ea59e77c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:48.928905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-af878ec9-9714-43c2-8eee-b78ea59e77c2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:48.930184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-af878ec9-9714-43c2-8eee-b78ea59e77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:48.971531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:49.024991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 563/1111] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:49.174497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59e6e-9122-4e7e-9cd7-bd59702f5846 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:49.176035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ede59e6e-9122-4e7e-9cd7-bd59702f5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:49.319877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59e6e-9122-4e7e-9cd7-bd59702f5846 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:49.373510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:49.431860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:49.432458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:49.432731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:49.432995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:49.434574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:49.521066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:49.522637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109de96-3a4b-4596-80f4-30a6400bc120 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:49.539927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 549/1112] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:50.578660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9b875-bb18-4901-ba38-324fa38b2dc7 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:50.579221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9b875-bb18-4901-ba38-324fa38b2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:50.579221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9b875-bb18-4901-ba38-324fa38b2dc7 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:50.580559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 564/1113] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:50.586833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925bac-19cf-4cdf-9c87-d7e259a8e6b6 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:50.587268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925bac-19cf-4cdf-9c87-d7e259a8e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:50.587387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6925bac-19cf-4cdf-9c87-d7e259a8e6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:50.661590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a6925bac-19cf-4cdf-9c87-d7e259a8e6b6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:50.662803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a6925bac-19cf-4cdf-9c87-d7e259a8e6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:50.664811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:50.763282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 550/1114] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:50.911824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9b875-bb18-4901-ba38-324fa38b2dc7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:50.913259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5bd9b875-bb18-4901-ba38-324fa38b2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:51.055315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9b875-bb18-4901-ba38-324fa38b2dc7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:51.082044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:51.167114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:51.167692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:51.167971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:51.168242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:51.169823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:51.259026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:51.260648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222c835-5e4b-4d7e-97a4-9270329a8188 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:51.278495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 565/1115] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:53.338564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44a00f-04d5-4326-9b20-12097d0bd66d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:53.339155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44a00f-04d5-4326-9b20-12097d0bd66d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:53.339155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44a00f-04d5-4326-9b20-12097d0bd66d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:53.340574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 551/1116] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:53.346397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab4b8-5107-427e-a945-27f596520ab1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:53.346795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab4b8-5107-427e-a945-27f596520ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:53.346963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab4b8-5107-427e-a945-27f596520ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:53.386373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:53.411292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1f7ab4b8-5107-427e-a945-27f596520ab1 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:53.412527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1f7ab4b8-5107-427e-a945-27f596520ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:53.507370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 566/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:03:53.794752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44a00f-04d5-4326-9b20-12097d0bd66d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:53.796378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0f44a00f-04d5-4326-9b20-12097d0bd66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:53.897163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44a00f-04d5-4326-9b20-12097d0bd66d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:53.928581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:53.970587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:53.971178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:53.971480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:53.971750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:53.973305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:54.077454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:54.079431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0f62d-5b2a-42e9-a69e-7b31c80de887 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:54.096630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 552/1118] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:56.375193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf611a-26cd-4535-82f0-7264bfeea2e3 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:56.375782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf611a-26cd-4535-82f0-7264bfeea2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:56.375782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf611a-26cd-4535-82f0-7264bfeea2e3 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:56.377118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 567/1119] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:56.382297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131415c6-69b1-45c0-82a7-b32fa3ecc5ad None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:56.382717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131415c6-69b1-45c0-82a7-b32fa3ecc5ad None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:56.382836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131415c6-69b1-45c0-82a7-b32fa3ecc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:56.448240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-131415c6-69b1-45c0-82a7-b32fa3ecc5ad None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:56.449425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-131415c6-69b1-45c0-82a7-b32fa3ecc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:56.462530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:56.546053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 553/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:03:56.836342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf611a-26cd-4535-82f0-7264bfeea2e3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:03:56.837887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-aadf611a-26cd-4535-82f0-7264bfeea2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:56.940108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf611a-26cd-4535-82f0-7264bfeea2e3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:03:56.952923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:57.012501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:03:57.013021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:57.013295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:57.013561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:57.015142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:57.120562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:03:57.121983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131b552-3a29-47e9-a6eb-1b2245d329f3 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:03:57.139225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 568/1121] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:59.585646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92b4b-0f8c-4639-906f-4f30e3e54ff0 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:59.586208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92b4b-0f8c-4639-906f-4f30e3e54ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:59.586304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92b4b-0f8c-4639-906f-4f30e3e54ff0 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:59.587649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 554/1122] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:03:59.592868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49ab35-b331-4be9-ba51-f7c4b779ef02 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:03:59.593319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49ab35-b331-4be9-ba51-f7c4b779ef02 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:03:59.593960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49ab35-b331-4be9-ba51-f7c4b779ef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:03:59.641205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:59.659608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6e49ab35-b331-4be9-ba51-f7c4b779ef02 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:03:59.660846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6e49ab35-b331-4be9-ba51-f7c4b779ef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:03:59.756102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 569/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:00.038211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a92b4b-0f8c-4639-906f-4f30e3e54ff0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:00.039764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d9a92b4b-0f8c-4639-906f-4f30e3e54ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:00.141088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a92b4b-0f8c-4639-906f-4f30e3e54ff0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:00.179429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:00.213621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:00.214216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:00.214501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:00.214771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:00.216412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:00.323038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:00.324507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b00cc9-3358-4b76-8f2d-da3021a7b7a0 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:00.342522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 555/1124] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:02.604252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981345-1837-403f-b5e4-34adcfc8445a None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:02.604796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981345-1837-403f-b5e4-34adcfc8445a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:02.604796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981345-1837-403f-b5e4-34adcfc8445a None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:02.606148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 570/1125] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:02.612239 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853ca01-46e8-44c7-9219-b9367d129ff9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:02.612663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853ca01-46e8-44c7-9219-b9367d129ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:02.612774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853ca01-46e8-44c7-9219-b9367d129ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:02.677302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5853ca01-46e8-44c7-9219-b9367d129ff9 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:02.678510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5853ca01-46e8-44c7-9219-b9367d129ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:02.699053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:02.775813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 556/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:03.058685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981345-1837-403f-b5e4-34adcfc8445a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:03.060256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-00981345-1837-403f-b5e4-34adcfc8445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:03.163284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981345-1837-403f-b5e4-34adcfc8445a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:03.184015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:03.237352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:03.237950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:03.238230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:03.238509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:03.240120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:03.350179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:03.351665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3f95-1450-4d8d-8609-1df0edc63f19 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:03.369934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 571/1127] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:05.655872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb08b-f193-49a6-8e0f-518dba37bbed None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:05.656432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb08b-f193-49a6-8e0f-518dba37bbed None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:05.656432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb08b-f193-49a6-8e0f-518dba37bbed None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:05.657788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 557/1128] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:05.663119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d57fe-b9bf-4349-b5f0-44aa9aa11aa8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:05.663567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d57fe-b9bf-4349-b5f0-44aa9aa11aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:05.663730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d57fe-b9bf-4349-b5f0-44aa9aa11aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:05.729279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:05.732439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-062d57fe-b9bf-4349-b5f0-44aa9aa11aa8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:05.734049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-062d57fe-b9bf-4349-b5f0-44aa9aa11aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:05.828144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 572/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:06.112039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cb08b-f193-49a6-8e0f-518dba37bbed None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:06.113551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-031cb08b-f193-49a6-8e0f-518dba37bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:06.213424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cb08b-f193-49a6-8e0f-518dba37bbed None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:06.262003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:06.286439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:06.287031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:06.287307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:06.287607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:06.289176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:06.395453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:06.396813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851d9e6-ccd0-4c58-b77a-ab3395a149f7 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:06.414515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 558/1130] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:08.611604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdfec4-85dc-42f7-9f7a-871ff969e1cd None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:08.612167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdfec4-85dc-42f7-9f7a-871ff969e1cd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:08.612167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdfec4-85dc-42f7-9f7a-871ff969e1cd None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:08.613502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 573/1131] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:08.618861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3279c-00f4-479b-9850-815ba9aa15cb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:08.619303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3279c-00f4-479b-9850-815ba9aa15cb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:08.619425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3279c-00f4-479b-9850-815ba9aa15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:08.685400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2ff3279c-00f4-479b-9850-815ba9aa15cb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:08.686612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2ff3279c-00f4-479b-9850-815ba9aa15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:08.723626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:08.794250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 559/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:09.079356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdfec4-85dc-42f7-9f7a-871ff969e1cd None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:09.080919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1cbdfec4-85dc-42f7-9f7a-871ff969e1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:09.181677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdfec4-85dc-42f7-9f7a-871ff969e1cd None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:09.210607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:09.254834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:09.255456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:09.255735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:09.256006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:09.257585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:09.364203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:09.365551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2144974-af6a-44f0-be98-779f6e53de04 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:09.383541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 574/1133] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:11.607590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5c5b-9693-438a-8c34-9d7e77fd595e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:11.608134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5c5b-9693-438a-8c34-9d7e77fd595e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:11.608134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5c5b-9693-438a-8c34-9d7e77fd595e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:11.609493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 560/1134] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:11.615462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9252-75d3-42b2-880f-f69243b70452 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:11.615854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9252-75d3-42b2-880f-f69243b70452 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:11.616046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9252-75d3-42b2-880f-f69243b70452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:11.682118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-19bd9252-75d3-42b2-880f-f69243b70452 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:11.683346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-19bd9252-75d3-42b2-880f-f69243b70452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:11.692131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:11.780810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 575/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:12.064797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5c5b-9693-438a-8c34-9d7e77fd595e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:12.066329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7d7f5c5b-9693-438a-8c34-9d7e77fd595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:12.169425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5c5b-9693-438a-8c34-9d7e77fd595e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:12.224814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:12.242713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:12.243341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:12.243649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:12.243921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:12.245511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:12.353299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:12.354742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0edac-9f6b-434c-a2a7-d18b056ad415 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:12.372464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 561/1136] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:14.569132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535dd9f-fd8a-452b-8227-96299d3ec1fe None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:14.569691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535dd9f-fd8a-452b-8227-96299d3ec1fe None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:14.569691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535dd9f-fd8a-452b-8227-96299d3ec1fe None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:14.570939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 576/1137] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:14.576524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586291c-6bb6-4172-9906-9198b384ca17 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:14.576938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586291c-6bb6-4172-9906-9198b384ca17 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:14.577068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586291c-6bb6-4172-9906-9198b384ca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:14.641456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-8586291c-6bb6-4172-9906-9198b384ca17 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:14.642663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8586291c-6bb6-4172-9906-9198b384ca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:14.681028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:14.739420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 562/1138] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:15.028767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535dd9f-fd8a-452b-8227-96299d3ec1fe None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:15.030331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3535dd9f-fd8a-452b-8227-96299d3ec1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:15.131561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535dd9f-fd8a-452b-8227-96299d3ec1fe None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:15.168392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:15.204665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:15.205264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:15.205541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:15.205810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:15.207387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:15.312437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:15.314444 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed2f02-b781-4273-a18d-9552d96f5f7d service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:15.332720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 577/1139] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:17.491794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f228-6f19-4b93-bd92-8f6a3a35dc60 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:17.492352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f228-6f19-4b93-bd92-8f6a3a35dc60 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:17.492352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f228-6f19-4b93-bd92-8f6a3a35dc60 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:17.493740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 563/1140] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:17.499236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcfdb8-06e0-43f3-9e7a-6987ae736e67 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:17.499663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcfdb8-06e0-43f3-9e7a-6987ae736e67 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:17.499862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcfdb8-06e0-43f3-9e7a-6987ae736e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:17.565663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-20dcfdb8-06e0-43f3-9e7a-6987ae736e67 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:17.566794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-20dcfdb8-06e0-43f3-9e7a-6987ae736e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:17.585179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:17.662595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 578/1141] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:17.948182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f228-6f19-4b93-bd92-8f6a3a35dc60 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:17.949961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-49a9f228-6f19-4b93-bd92-8f6a3a35dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:18.050867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f228-6f19-4b93-bd92-8f6a3a35dc60 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:18.116513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:18.123241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:18.123874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:18.124148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:18.124420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:18.126025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:18.232491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:18.233844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5047d-bf63-45c6-9ed6-847e9319baaa service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:18.251557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 564/1142] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:20.398127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998652-c9c8-4311-b558-3b9fb16bced5 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:20.398679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998652-c9c8-4311-b558-3b9fb16bced5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:20.398679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998652-c9c8-4311-b558-3b9fb16bced5 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:20.400033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 579/1143] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:20.405409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48729cf-cfd2-45a6-bd4e-62a1b8b35160 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:20.405825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48729cf-cfd2-45a6-bd4e-62a1b8b35160 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:20.405979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48729cf-cfd2-45a6-bd4e-62a1b8b35160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:20.472933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b48729cf-cfd2-45a6-bd4e-62a1b8b35160 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:20.474148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b48729cf-cfd2-45a6-bd4e-62a1b8b35160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:20.521036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:20.569196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 565/1144] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:20.856295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998652-c9c8-4311-b558-3b9fb16bced5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:20.857828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-60998652-c9c8-4311-b558-3b9fb16bced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:20.963904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998652-c9c8-4311-b558-3b9fb16bced5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:21.011372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:21.036086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:21.036682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:21.036957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:21.037223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:21.038786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:21.146398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:21.147874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa33397-6f37-4bd0-aee9-191e1ee1bc20 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:21.166078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 580/1145] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:30.567703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=22 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:31.163831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=66 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:40.983167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf16f1-0127-4ca2-822d-345c3f37bd6d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:40.983736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf16f1-0127-4ca2-822d-345c3f37bd6d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:40.983736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf16f1-0127-4ca2-822d-345c3f37bd6d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:40.985015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 566/1146] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:40.990361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb19e2-19ff-434c-8fdc-23def08e26dd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:40.990802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb19e2-19ff-434c-8fdc-23def08e26dd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:40.990915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb19e2-19ff-434c-8fdc-23def08e26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:41.055743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-54eb19e2-19ff-434c-8fdc-23def08e26dd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:41.056980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-54eb19e2-19ff-434c-8fdc-23def08e26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:41.154458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 581/1147] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:04:41.453926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1741-b447-499f-81fc-74a95d6d35ec None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:41.454237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1741-b447-499f-81fc-74a95d6d35ec None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:41.454525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1741-b447-499f-81fc-74a95d6d35ec None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:41.456434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 567/1148] 10.222.0.25 () {54 vars in 962 bytes} [Thu Oct 13 13:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:41.461573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44198e-89e0-4f5b-bd16-8fd54043cb26 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:41.461859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44198e-89e0-4f5b-bd16-8fd54043cb26 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:41.462136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44198e-89e0-4f5b-bd16-8fd54043cb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:41.536690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7b44198e-89e0-4f5b-bd16-8fd54043cb26 None None] MFA Rules not processed for user `5fc9d2d85fbd449c86ea50f1d46ce009`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:41.537892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7b44198e-89e0-4f5b-bd16-8fd54043cb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:41.557921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:41.612280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 582/1149] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Oct 13 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:41.620032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1741-b447-499f-81fc-74a95d6d35ec None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:41.621532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-777c1741-b447-499f-81fc-74a95d6d35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:41.724503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1741-b447-499f-81fc-74a95d6d35ec None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:41.796941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:41.797576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:41.797859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:41.798135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:41.800309 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:41.853275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:41.907515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:41.908985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598b9c8-4317-4ab5-8c69-4550b192f5d8 service glance] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:41.928645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 568/1150] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:44.159485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a79498-8b13-4a09-bc84-b9caad755d65 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:44.159916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a79498-8b13-4a09-bc84-b9caad755d65 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:44.160065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a79498-8b13-4a09-bc84-b9caad755d65 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:44.161507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 583/1151] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:44.166763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f480-77a7-4961-9d99-4bad23c67d12 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:44.167233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f480-77a7-4961-9d99-4bad23c67d12 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:44.167329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f480-77a7-4961-9d99-4bad23c67d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:44.232894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-59d4f480-77a7-4961-9d99-4bad23c67d12 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:44.234113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-59d4f480-77a7-4961-9d99-4bad23c67d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:44.329176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 569/1152] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:44.603057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a79498-8b13-4a09-bc84-b9caad755d65 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:44.604638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-07a79498-8b13-4a09-bc84-b9caad755d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:44.727594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a79498-8b13-4a09-bc84-b9caad755d65 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:44.775654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:44.820881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:44.821488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:44.821770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:44.822043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:44.822680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:44.823725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:04:44.823725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 13:04:44.823725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 13:04:44.824857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196998e-fe2e-448e-a75f-a0eb81eeb8cf admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:44.843700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 584/1153] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 13:04:44 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:04:46.990202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3432b44-f19a-4caa-a054-2904325efa8d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:46.990732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3432b44-f19a-4caa-a054-2904325efa8d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:46.990732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3432b44-f19a-4caa-a054-2904325efa8d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:46.992029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 570/1154] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:46.997180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f1c74-30d2-4e0c-92fd-91d840a0c048 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:46.997575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f1c74-30d2-4e0c-92fd-91d840a0c048 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:46.997722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f1c74-30d2-4e0c-92fd-91d840a0c048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:47.063887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-675f1c74-30d2-4e0c-92fd-91d840a0c048 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:47.065653 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-675f1c74-30d2-4e0c-92fd-91d840a0c048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:47.159022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 585/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:47.450352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3432b44-f19a-4caa-a054-2904325efa8d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:47.452225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f3432b44-f19a-4caa-a054-2904325efa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:47.462156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:47.596327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3432b44-f19a-4caa-a054-2904325efa8d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:47.675038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:47.708393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:47.708997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:47.709281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:47.709554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:47.711194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:47.801885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:47.803514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acab427-a0ac-412c-ac92-d6d24e81e9bd service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:47.821005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 571/1156] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:50.121675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f854bf-2d18-446f-a95f-05d8a7467b1d None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:50.122229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f854bf-2d18-446f-a95f-05d8a7467b1d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:50.122229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f854bf-2d18-446f-a95f-05d8a7467b1d None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:50.123630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 586/1157] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:50.129618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e94351-8fd4-44f9-8de4-6ffc693df976 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:50.130034 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e94351-8fd4-44f9-8de4-6ffc693df976 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:50.130195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e94351-8fd4-44f9-8de4-6ffc693df976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:50.195352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f0e94351-8fd4-44f9-8de4-6ffc693df976 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:50.196583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f0e94351-8fd4-44f9-8de4-6ffc693df976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:50.241444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:50.291515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 572/1158] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:50.583135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f854bf-2d18-446f-a95f-05d8a7467b1d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:50.584695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a0f854bf-2d18-446f-a95f-05d8a7467b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:50.608401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:50.687802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f854bf-2d18-446f-a95f-05d8a7467b1d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:50.760759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:50.761360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:50.761643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:50.761914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:50.763517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:50.836752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:50.872225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:50.873671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df376cb8-c0c1-46f1-a4db-300e4e6f1ca8 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:50.893086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 587/1159] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:53.091328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c05dc-da91-4866-adc9-20d29c9250ce None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:53.091943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c05dc-da91-4866-adc9-20d29c9250ce None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:53.091943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c05dc-da91-4866-adc9-20d29c9250ce None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:53.093271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 573/1160] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:53.098635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96233f-b1ba-4f98-a344-109e0380c8c3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:53.099075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96233f-b1ba-4f98-a344-109e0380c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:53.099177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96233f-b1ba-4f98-a344-109e0380c8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:53.164158 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3b96233f-b1ba-4f98-a344-109e0380c8c3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:53.165375 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3b96233f-b1ba-4f98-a344-109e0380c8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:53.260556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 588/1161] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:53.550740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c05dc-da91-4866-adc9-20d29c9250ce None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:53.552297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-dc5c05dc-da91-4866-adc9-20d29c9250ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:53.653916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c05dc-da91-4866-adc9-20d29c9250ce None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:53.725924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:53.727408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:53.728138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:53.728627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:53.729051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:53.730801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:53.837387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:53.838809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b603fd5-0fa4-4ef0-8b18-bbf635504f2d service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:53.856028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 574/1162] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:56.091233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b46e-97f6-4565-8913-da8324c7963e None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:56.091825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b46e-97f6-4565-8913-da8324c7963e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:56.091825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b46e-97f6-4565-8913-da8324c7963e None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:56.093130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 589/1163] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:56.098563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e891f2-3d3b-47cb-91f0-8ecc16f7c43b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:56.099017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e891f2-3d3b-47cb-91f0-8ecc16f7c43b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:56.099122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e891f2-3d3b-47cb-91f0-8ecc16f7c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:56.165209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c2e891f2-3d3b-47cb-91f0-8ecc16f7c43b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:56.166398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c2e891f2-3d3b-47cb-91f0-8ecc16f7c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:56.218548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:56.262103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 575/1164] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:56.617273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b46e-97f6-4565-8913-da8324c7963e None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:56.618886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9e87b46e-97f6-4565-8913-da8324c7963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:56.654122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:56.723798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b46e-97f6-4565-8913-da8324c7963e None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:04:56.796153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:04:56.796757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:56.797037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:56.797308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:56.798903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:56.877188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:56.906494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:04:56.908002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b30b-0d5c-4602-8878-9b6ab9b750fe service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:04:56.926468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 590/1165] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:04:59.244153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e595e-fd05-424a-895a-2191b0892fb1 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:59.244723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e595e-fd05-424a-895a-2191b0892fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:59.244723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e595e-fd05-424a-895a-2191b0892fb1 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:59.246060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 576/1166] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 13:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:59.251666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e26f-a049-451e-a19e-3d425b60fefe None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:59.252077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e26f-a049-451e-a19e-3d425b60fefe None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:59.252217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e26f-a049-451e-a19e-3d425b60fefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:59.318738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7699e26f-a049-451e-a19e-3d425b60fefe None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:59.320002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7699e26f-a049-451e-a19e-3d425b60fefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:59.413898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 591/1167] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:04:59.718523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3e05-d9fe-41e2-800b-c9e1bb9797a8 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:59.718805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3e05-d9fe-41e2-800b-c9e1bb9797a8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:59.719076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3e05-d9fe-41e2-800b-c9e1bb9797a8 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:59.720468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 577/1168] 10.222.0.25 () {54 vars in 964 bytes} [Thu Oct 13 13:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:04:59.726426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fece7-539d-4586-8e47-b23cc6b0b5b9 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:04:59.726933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fece7-539d-4586-8e47-b23cc6b0b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:04:59.727766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fece7-539d-4586-8e47-b23cc6b0b5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:04:59.777358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:59.801937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-113fece7-539d-4586-8e47-b23cc6b0b5b9 None None] MFA Rules not processed for user `0fd9d9e53d0f4a2ca149de05ff08d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:04:59.803137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-113fece7-539d-4586-8e47-b23cc6b0b5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:59.876659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 592/1169] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Oct 13 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:04:59.886255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3e05-d9fe-41e2-800b-c9e1bb9797a8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:04:59.887825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-29fd3e05-d9fe-41e2-800b-c9e1bb9797a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:04:59.989199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3e05-d9fe-41e2-800b-c9e1bb9797a8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:05:00.061090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:05:00.061690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:05:00.061973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:05:00.062246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:05:00.063900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:05:00.073048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:05:00.172700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:05:00.174142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4b3c-492b-43df-9080-c767be2a9d2f service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:05:00.193519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 578/1170] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:05:09.875164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=41 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:05:10.191569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=50 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:19.384362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:19.384822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:19.384921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:19.462480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:06:19.463709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:19.557792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 593/1171] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:06:19.565795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:19.566266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:19.566482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:19.642871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:06:19.644033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:19.738847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 579/1172] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:06:19.744021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:19.745270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:19.756524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2a717-8b3a-4d66-b57e-ef4e94f3952b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:19.816916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:19.849425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:19.850055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:19.850868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:19.851135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:19.851815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:06:19.852118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:19.853129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:06:19.853129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 13:06:19.853129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 13:06:19.854014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:19.865833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 594/1173] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:06:19.875851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:19.884995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d613f5-2e62-4872-873f-c61e3cee4bb8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:19.944405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:19.977803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:19.978402 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:19.978679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:19.978945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:19.979610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:19.980773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:06:19.980773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 13:06:19.980773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 13:06:19.981946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:20.035500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 580/1174] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:06:19 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:06:20.040303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:20.041874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:20.073712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f2712-5d44-491d-b55a-65d8ab945ea9 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:20.165217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:20.165818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.166093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.166360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.166995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:20.168037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:06:20.168037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 13:06:20.168037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 13:06:20.169230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:20.210181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 595/1175] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:06:20 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:06:20.214172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:20.215715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:20.276833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13377c-ad98-40c1-81fc-ce7683a8a94e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:20.361221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:20.372120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:20.372724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.373000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.373271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.373904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:20.375532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:20.388023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 581/1176] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:06:20.392002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:20.393509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:20.405600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd302-4138-4610-8694-d7fcbd9fa98d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:20.429726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:20.499611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebfa6-fdb7-436f-9842-c6ed6574b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:20.500143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebfa6-fdb7-436f-9842-c6ed6574b220 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.500420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebfa6-fdb7-436f-9842-c6ed6574b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.500690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebfa6-fdb7-436f-9842-c6ed6574b220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.501325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ebfa6-fdb7-436f-9842-c6ed6574b220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:20.502918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ebfa6-fdb7-436f-9842-c6ed6574b220 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:20.515366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 596/1177] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:06:20.519713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:20.521221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:20.553997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b5ab-e309-4dd0-80a1-64ce71331bcb admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:20.646791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2888-37eb-4693-a799-70a59124f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:20.648009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2888-37eb-4693-a799-70a59124f85b admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.648251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2888-37eb-4693-a799-70a59124f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.648514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2888-37eb-4693-a799-70a59124f85b admin admin] PATH_INFO: `/v3/projects/21c7ffa73c9344d6a9e8042fc68d0076/users/ded0105f5ca841d6adf0539183634028/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.670117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e2888-37eb-4693-a799-70a59124f85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c7ffa73c9344d6a9e8042fc68d0076, user_id=ded0105f5ca841d6adf0539183634028, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:20.672799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e2888-37eb-4693-a799-70a59124f85b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:20.697458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 582/1178] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:06:20 2022] PUT /identity/v3/projects/21c7ffa73c9344d6a9e8042fc68d0076/users/ded0105f5ca841d6adf0539183634028/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:06:20.708610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c224d9-a333-4938-a982-038c2b386624 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.708896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c224d9-a333-4938-a982-038c2b386624 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.709168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c224d9-a333-4938-a982-038c2b386624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.767790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a1c224d9-a333-4938-a982-038c2b386624 None None] MFA Rules not processed for user `ded0105f5ca841d6adf0539183634028`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:06:20.768966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a1c224d9-a333-4938-a982-038c2b386624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:20.844300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 597/1179] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:06:20.857911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825632-e374-4b0c-8184-98962f375a21 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.858196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825632-e374-4b0c-8184-98962f375a21 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.858463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825632-e374-4b0c-8184-98962f375a21 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.859835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 583/1180] 10.222.0.25 () {54 vars in 963 bytes} [Thu Oct 13 13:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:06:20.864677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc96a69-a3b6-474f-84fb-d08805fe332e None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:20.864968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc96a69-a3b6-474f-84fb-d08805fe332e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:20.865251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc96a69-a3b6-474f-84fb-d08805fe332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:20.895657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:20.939821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1cc96a69-a3b6-474f-84fb-d08805fe332e None None] MFA Rules not processed for user `a96fabf57bae435eaf4b6c61cbb89346`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:06:20.941020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1cc96a69-a3b6-474f-84fb-d08805fe332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:21.014967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 598/1181] 10.222.0.25 () {58 vars in 1060 bytes} [Thu Oct 13 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:06:21.025151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825632-e374-4b0c-8184-98962f375a21 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:21.026575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-25825632-e374-4b0c-8184-98962f375a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:21.075909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:21.129260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825632-e374-4b0c-8184-98962f375a21 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:21.209462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:21.210622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:21.210900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:21.211168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:21.212809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:21.308904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:21.310304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:21.313750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:21.328922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 584/1182] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:06:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:06:21.374461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1cd7f-a475-4a7f-b075-dfa164329cb7 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:21.374754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1cd7f-a475-4a7f-b075-dfa164329cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:21.375029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1cd7f-a475-4a7f-b075-dfa164329cb7 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:21.376325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 599/1183] 10.222.0.25 () {52 vars in 830 bytes} [Thu Oct 13 13:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:06:21.379845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:21.381116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:21.481074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4485-20f3-4b97-bd92-3033f21746d0 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:21.572581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:21.573205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:21.573484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:21.573753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] PATH_INFO: `/v3/users/ded0105f5ca841d6adf0539183634028` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:21.586420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded0105f5ca841d6adf0539183634028)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:21.587466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:06:21.587466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 13:06:21.587466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 13:06:21.588680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:21.597996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:21.653799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded0105f5ca841d6adf0539183634028'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:21.667288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded0105f5ca841d6adf0539183634028'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:21.690307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded0105f5ca841d6adf0539183634028'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:21.690759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded0105f5ca841d6adf0539183634028'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:21.700063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded0105f5ca841d6adf0539183634028'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:21.706017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 585/1184] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:06:21 2022] DELETE /identity/v3/users/ded0105f5ca841d6adf0539183634028 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:06:21.711057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:21.711593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:21.711702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:21.768141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:06:21.769363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:21.843076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:21.856899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 600/1185] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:06:21.867258 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:21.868519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:21.966255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e81c6-c52e-4e2c-97af-98f771b7d199 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:22.019723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:22.040142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:22.040748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:22.041025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:22.041315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:22.042912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:22.151652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:22.153020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9a6d2-5600-4e58-9b34-230270588d65 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:22.171203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 586/1186] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:06:22.518820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:06:22.520078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:06:22.531965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791c58d-e79b-4f47-ba60-705cd577ab13 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:06:22.630488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:06:22.631113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:06:22.632220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:06:22.632813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] PATH_INFO: `/v3/projects/21c7ffa73c9344d6a9e8042fc68d0076` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:06:22.643196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c7ffa73c9344d6a9e8042fc68d0076)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:06:22.644255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:06:22.644255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 13:06:22.644255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 13:06:22.645463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:06:22.701752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c7ffa73c9344d6a9e8042fc68d0076', 'request_id': 'req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:22.716078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c7ffa73c9344d6a9e8042fc68d0076', 'request_id': 'req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:22.725512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c7ffa73c9344d6a9e8042fc68d0076', 'request_id': 'req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:22.747939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] The token cache is being invalidate because project 21c7ffa73c9344d6a9e8042fc68d0076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:06:22.748229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:22.748745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5aa4cd3-6879-48b9-bbd3-f513a57cb723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:06:22.750051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 601/1187] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:06:22 2022] DELETE /identity/v3/projects/21c7ffa73c9344d6a9e8042fc68d0076 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:06:32.168866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=62 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:06:32.745966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:07:57.428787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e39cf-c578-41a6-b80b-24844018beb2 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:57.429246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e39cf-c578-41a6-b80b-24844018beb2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:57.429347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e39cf-c578-41a6-b80b-24844018beb2 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:57.430709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 587/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:07:57.435607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de621eda-151d-4c20-ac58-be1129234791 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:57.436012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de621eda-151d-4c20-ac58-be1129234791 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:57.436182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de621eda-151d-4c20-ac58-be1129234791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:57.514982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-de621eda-151d-4c20-ac58-be1129234791 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:07:57.516209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-de621eda-151d-4c20-ac58-be1129234791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:07:57.617770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 602/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:07:57.771920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e39cf-c578-41a6-b80b-24844018beb2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:07:57.774602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-028e39cf-c578-41a6-b80b-24844018beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:07:57.892040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e39cf-c578-41a6-b80b-24844018beb2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:07:57.897448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15fbe1-bbe1-4857-be37-e724f0c5870c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:07:57.898048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15fbe1-bbe1-4857-be37-e724f0c5870c service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:57.898331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15fbe1-bbe1-4857-be37-e724f0c5870c service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:57.898609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15fbe1-bbe1-4857-be37-e724f0c5870c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:57.906944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15fbe1-bbe1-4857-be37-e724f0c5870c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:07:57.908567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15fbe1-bbe1-4857-be37-e724f0c5870c service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:07:57.917804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 588/1190] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:07:58.991083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228add-cbb2-4ddd-919f-d08025fa1db1 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:58.991630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228add-cbb2-4ddd-919f-d08025fa1db1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:58.991630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228add-cbb2-4ddd-919f-d08025fa1db1 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:58.992994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 603/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:07:58.999451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9c20d-11ae-40af-b7eb-6186393900f2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:58.999965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9c20d-11ae-40af-b7eb-6186393900f2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:58.999965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9c20d-11ae-40af-b7eb-6186393900f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:59.019240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c3e9c20d-11ae-40af-b7eb-6186393900f2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:07:59.020456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c3e9c20d-11ae-40af-b7eb-6186393900f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:07:59.028733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 589/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:07:59.180759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17228add-cbb2-4ddd-919f-d08025fa1db1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:07:59.196565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17228add-cbb2-4ddd-919f-d08025fa1db1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:07:59.201935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecd25d-ebbd-4f5b-85c0-c7133af94c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:07:59.202532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecd25d-ebbd-4f5b-85c0-c7133af94c00 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:59.202806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecd25d-ebbd-4f5b-85c0-c7133af94c00 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:59.203075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecd25d-ebbd-4f5b-85c0-c7133af94c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:59.210921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecd25d-ebbd-4f5b-85c0-c7133af94c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:07:59.212569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecd25d-ebbd-4f5b-85c0-c7133af94c00 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:07:59.221962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 604/1193] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:07:59.609269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f3b8-69c1-4f97-af66-6e7a2ad2ec29 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:59.609553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f3b8-69c1-4f97-af66-6e7a2ad2ec29 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:59.609824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f3b8-69c1-4f97-af66-6e7a2ad2ec29 None None] PATH_INFO: `/v3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:59.611110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 590/1194] 10.222.0.26 () {54 vars in 925 bytes} [Thu Oct 13 13:07:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:07:59.617263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bb6a-6ce2-4fe3-bbb0-27ce96aff1bc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:07:59.618222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bb6a-6ce2-4fe3-bbb0-27ce96aff1bc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:07:59.618495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bb6a-6ce2-4fe3-bbb0-27ce96aff1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:07:59.677236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-4204bb6a-6ce2-4fe3-bbb0-27ce96aff1bc None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:07:59.678445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4204bb6a-6ce2-4fe3-bbb0-27ce96aff1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:07:59.695067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:07:59.750550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 605/1195] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Oct 13 13:07:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:03.326607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29699c-f987-4440-a50d-6f1d79316120 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:03.327039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29699c-f987-4440-a50d-6f1d79316120 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:03.327249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29699c-f987-4440-a50d-6f1d79316120 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:03.328623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 591/1196] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 13:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:08:03.333540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b30c-5c04-4852-9d69-f85d51472be6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:03.333990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b30c-5c04-4852-9d69-f85d51472be6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:03.334096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b30c-5c04-4852-9d69-f85d51472be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:03.355644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1a11b30c-5c04-4852-9d69-f85d51472be6 None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:03.356849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1a11b30c-5c04-4852-9d69-f85d51472be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:03.365309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 606/1197] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:03.372897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29699c-f987-4440-a50d-6f1d79316120 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:03.387338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29699c-f987-4440-a50d-6f1d79316120 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:03.393678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696bff3-e677-4faa-9a25-5fa4c5e01539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:03.394272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696bff3-e677-4faa-9a25-5fa4c5e01539 service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:03.394549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696bff3-e677-4faa-9a25-5fa4c5e01539 service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:03.394820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696bff3-e677-4faa-9a25-5fa4c5e01539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:03.403631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696bff3-e677-4faa-9a25-5fa4c5e01539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:03.405211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696bff3-e677-4faa-9a25-5fa4c5e01539 service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:03.415976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 592/1198] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:10.689312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35925c-ffdf-4ade-b64f-217a5ccf318e None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:10.689753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35925c-ffdf-4ade-b64f-217a5ccf318e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:10.689866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35925c-ffdf-4ade-b64f-217a5ccf318e None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:10.691234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 607/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:08:10.697625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf55645-6087-47b6-be44-da5f7c20d10c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:10.698082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf55645-6087-47b6-be44-da5f7c20d10c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:10.698184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf55645-6087-47b6-be44-da5f7c20d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:10.717796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4bf55645-6087-47b6-be44-da5f7c20d10c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:10.718989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4bf55645-6087-47b6-be44-da5f7c20d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:10.726771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 593/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:10.879380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35925c-ffdf-4ade-b64f-217a5ccf318e None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:10.894110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35925c-ffdf-4ade-b64f-217a5ccf318e None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:10.899542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82065f2-6f27-40e7-ae5e-0c43b0296271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:10.900137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82065f2-6f27-40e7-ae5e-0c43b0296271 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:10.900420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82065f2-6f27-40e7-ae5e-0c43b0296271 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:10.900694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82065f2-6f27-40e7-ae5e-0c43b0296271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:10.908641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82065f2-6f27-40e7-ae5e-0c43b0296271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:10.910228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82065f2-6f27-40e7-ae5e-0c43b0296271 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:10.919972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 608/1201] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:11.980772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29122-115b-41bc-8667-28ae2c50cbdf None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:11.981304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29122-115b-41bc-8667-28ae2c50cbdf None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:11.981304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29122-115b-41bc-8667-28ae2c50cbdf None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:11.982574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 594/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 13:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:08:11.988712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c29021-43fb-450a-8f03-a26336a0f053 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:11.989145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c29021-43fb-450a-8f03-a26336a0f053 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:11.989267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c29021-43fb-450a-8f03-a26336a0f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:12.008438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-32c29021-43fb-450a-8f03-a26336a0f053 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:12.009628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-32c29021-43fb-450a-8f03-a26336a0f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:12.017914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 609/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:12.167958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b29122-115b-41bc-8667-28ae2c50cbdf None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:12.182872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b29122-115b-41bc-8667-28ae2c50cbdf None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:12.188291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50ccd-7611-4db0-b55f-0974db43b07c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:12.188880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50ccd-7611-4db0-b55f-0974db43b07c service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:12.189166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50ccd-7611-4db0-b55f-0974db43b07c service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:12.189438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50ccd-7611-4db0-b55f-0974db43b07c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:12.197298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50ccd-7611-4db0-b55f-0974db43b07c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:12.198924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50ccd-7611-4db0-b55f-0974db43b07c service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:12.208080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 595/1204] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:16.217713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527c2cd-5e5d-4b0f-b6ab-9d4e3b18b608 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:16.218299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527c2cd-5e5d-4b0f-b6ab-9d4e3b18b608 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:16.218299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527c2cd-5e5d-4b0f-b6ab-9d4e3b18b608 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:16.219642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 610/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:08:16.224745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e895e9-b5c3-4251-abdf-cf4406361146 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:16.225169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e895e9-b5c3-4251-abdf-cf4406361146 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:16.225292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e895e9-b5c3-4251-abdf-cf4406361146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:16.245471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-97e895e9-b5c3-4251-abdf-cf4406361146 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:16.246667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-97e895e9-b5c3-4251-abdf-cf4406361146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:16.254324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 596/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:16.542524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527c2cd-5e5d-4b0f-b6ab-9d4e3b18b608 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:16.544249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7527c2cd-5e5d-4b0f-b6ab-9d4e3b18b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:16.619669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527c2cd-5e5d-4b0f-b6ab-9d4e3b18b608 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:16.623195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4207-1d1c-402c-921b-6aec73208207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:16.623892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4207-1d1c-402c-921b-6aec73208207 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:16.624179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4207-1d1c-402c-921b-6aec73208207 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:16.624449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4207-1d1c-402c-921b-6aec73208207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:16.633171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4207-1d1c-402c-921b-6aec73208207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:16.634587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4207-1d1c-402c-921b-6aec73208207 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:16.644052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 611/1207] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:18.744277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d57e-ff9c-49b7-a103-aa486bea3c55 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:18.745266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d57e-ff9c-49b7-a103-aa486bea3c55 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:18.745363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d57e-ff9c-49b7-a103-aa486bea3c55 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:18.746697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 597/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:08:18.751818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876877-c2bc-49a7-ba8f-a09482255e4d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:18.752249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876877-c2bc-49a7-ba8f-a09482255e4d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:18.752374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876877-c2bc-49a7-ba8f-a09482255e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:18.772062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3e876877-c2bc-49a7-ba8f-a09482255e4d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:18.773274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3e876877-c2bc-49a7-ba8f-a09482255e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:18.781161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 612/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:19.068274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d57e-ff9c-49b7-a103-aa486bea3c55 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:19.080398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d57e-ff9c-49b7-a103-aa486bea3c55 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:19.084158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3adb1-4b5b-495a-877b-c53022cfc3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:19.084746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3adb1-4b5b-495a-877b-c53022cfc3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:19.085027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3adb1-4b5b-495a-877b-c53022cfc3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:19.085299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3adb1-4b5b-495a-877b-c53022cfc3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:19.094198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3adb1-4b5b-495a-877b-c53022cfc3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:19.095651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3adb1-4b5b-495a-877b-c53022cfc3c2 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:19.105316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 598/1210] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:22.708199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa371-a4f5-41bb-b220-b81089804bf6 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:22.708804 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa371-a4f5-41bb-b220-b81089804bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:22.708804 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa371-a4f5-41bb-b220-b81089804bf6 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:22.710097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 613/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:08:22.715571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcd9d-5a8d-4e22-a68b-3b0d701de119 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:22.716023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcd9d-5a8d-4e22-a68b-3b0d701de119 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:22.716122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcd9d-5a8d-4e22-a68b-3b0d701de119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:22.723902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=81 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:08:22.737422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-070bcd9d-5a8d-4e22-a68b-3b0d701de119 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:22.738661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-070bcd9d-5a8d-4e22-a68b-3b0d701de119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:22.747256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 599/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:23.058080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa371-a4f5-41bb-b220-b81089804bf6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:23.059786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-908aa371-a4f5-41bb-b220-b81089804bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:23.123253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:08:23.136373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa371-a4f5-41bb-b220-b81089804bf6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:23.139894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e2ea6-1196-42f1-8c0f-0aed49cc6b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:23.140488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2ea6-1196-42f1-8c0f-0aed49cc6b72 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:23.140762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2ea6-1196-42f1-8c0f-0aed49cc6b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:23.141029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2ea6-1196-42f1-8c0f-0aed49cc6b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:23.149665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e2ea6-1196-42f1-8c0f-0aed49cc6b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:23.151637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e2ea6-1196-42f1-8c0f-0aed49cc6b72 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:23.160721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 614/1213] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:25.262389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f8297-e126-4500-a53c-e5d94565b92d None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:25.262967 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f8297-e126-4500-a53c-e5d94565b92d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:25.262967 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f8297-e126-4500-a53c-e5d94565b92d None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:25.264319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 600/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 13:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:08:25.269440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03138-4092-4960-8331-1c7b4591c38e None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:25.269880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03138-4092-4960-8331-1c7b4591c38e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:25.270036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03138-4092-4960-8331-1c7b4591c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:25.289892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-bde03138-4092-4960-8331-1c7b4591c38e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:08:25.291106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-bde03138-4092-4960-8331-1c7b4591c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:25.299084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 615/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 13:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:08:25.609953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f8297-e126-4500-a53c-e5d94565b92d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:08:25.611678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e29f8297-e126-4500-a53c-e5d94565b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:08:25.624906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f8297-e126-4500-a53c-e5d94565b92d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:08:25.629517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd71fc-b423-40fb-bb1e-4756e2ddd110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:08:25.630114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd71fc-b423-40fb-bb1e-4756e2ddd110 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:08:25.630389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd71fc-b423-40fb-bb1e-4756e2ddd110 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:08:25.630664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd71fc-b423-40fb-bb1e-4756e2ddd110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:08:25.640473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd71fc-b423-40fb-bb1e-4756e2ddd110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:08:25.641904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd71fc-b423-40fb-bb1e-4756e2ddd110 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:08:25.653474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 601/1216] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:08:35.285090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=11 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:08:35.648842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=8 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:58.018238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.018867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.018867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.046661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.052558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.065374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 616/1217] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:09:58.075551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.076142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.076142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.108795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.110031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.124103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 602/1218] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.128681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.144427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d781-e141-4587-8b13-3fc5f4bee9ab None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.152602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.153372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.153661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.153929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.154595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.154878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.156508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.176088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 617/1219] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.185176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.201205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589271cf-3228-4d08-b622-c5b071feef1e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.210377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61605570-17c5-4ca0-9f80-b9167810fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.211014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61605570-17c5-4ca0-9f80-b9167810fd04 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.211291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61605570-17c5-4ca0-9f80-b9167810fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.211589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61605570-17c5-4ca0-9f80-b9167810fd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.212235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61605570-17c5-4ca0-9f80-b9167810fd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.214182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61605570-17c5-4ca0-9f80-b9167810fd04 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.270446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 603/1220] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:58.275993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.289542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfb3ad-3cd9-43c5-a5bf-5d800114396a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.308604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222896-4c45-4c32-ad26-a6ac6bf5bf25 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.308920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222896-4c45-4c32-ad26-a6ac6bf5bf25 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.309146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222896-4c45-4c32-ad26-a6ac6bf5bf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.348477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2b222896-4c45-4c32-ad26-a6ac6bf5bf25 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.350085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2b222896-4c45-4c32-ad26-a6ac6bf5bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.381844 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d05df-c231-4b29-89ce-5e2df94233ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.382463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d05df-c231-4b29-89ce-5e2df94233ed admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.382818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d05df-c231-4b29-89ce-5e2df94233ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.383104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d05df-c231-4b29-89ce-5e2df94233ed admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.383781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d05df-c231-4b29-89ce-5e2df94233ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.385914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d05df-c231-4b29-89ce-5e2df94233ed admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.427717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 618/1221] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:58.428978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9da83-da03-435e-9a15-797b311db95d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.429272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9da83-da03-435e-9a15-797b311db95d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.429545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9da83-da03-435e-9a15-797b311db95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.463715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-05a9da83-da03-435e-9a15-797b311db95d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.464966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-05a9da83-da03-435e-9a15-797b311db95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.466619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 604/1222] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.467790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.468077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.468350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.480334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 619/1223] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.487254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30c0f-66e9-41de-b62b-920d3f8f8d32 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.487254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30c0f-66e9-41de-b62b-920d3f8f8d32 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.487254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30c0f-66e9-41de-b62b-920d3f8f8d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.492002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.493234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.502603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 605/1224] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.503463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.508609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-79b30c0f-66e9-41de-b62b-920d3f8f8d32 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.509813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-79b30c0f-66e9-41de-b62b-920d3f8f8d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.513481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498df0f-0c69-464e-b741-6843f3825081 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.517790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 620/1225] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.518025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfcdaa-e906-485a-b6f9-8460fec267db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.518640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfcdaa-e906-485a-b6f9-8460fec267db admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.518898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfcdaa-e906-485a-b6f9-8460fec267db admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.519112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56685-4933-4f46-bbf0-34626f089ae4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.519241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfcdaa-e906-485a-b6f9-8460fec267db admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.519450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56685-4933-4f46-bbf0-34626f089ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.519661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56685-4933-4f46-bbf0-34626f089ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.519841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfcdaa-e906-485a-b6f9-8460fec267db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.522042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfcdaa-e906-485a-b6f9-8460fec267db admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.532623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 606/1226] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:58.533769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df7031-0a21-480f-a1e8-269695c9b28d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.534102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df7031-0a21-480f-a1e8-269695c9b28d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.534321 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df7031-0a21-480f-a1e8-269695c9b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.540147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-8cf56685-4933-4f46-bbf0-34626f089ae4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.541344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8cf56685-4933-4f46-bbf0-34626f089ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.549567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 621/1227] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.550809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce794e-0405-4ac0-a8c5-5f5c04fdb26c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.551095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce794e-0405-4ac0-a8c5-5f5c04fdb26c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.551366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce794e-0405-4ac0-a8c5-5f5c04fdb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.553778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d2df7031-0a21-480f-a1e8-269695c9b28d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.554966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d2df7031-0a21-480f-a1e8-269695c9b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.563036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 607/1228] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.564596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4eb66-cd4d-4e79-aa7b-7d1b0c2d9d9c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.564883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4eb66-cd4d-4e79-aa7b-7d1b0c2d9d9c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.565160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4eb66-cd4d-4e79-aa7b-7d1b0c2d9d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.571797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-75ce794e-0405-4ac0-a8c5-5f5c04fdb26c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.573014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-75ce794e-0405-4ac0-a8c5-5f5c04fdb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.580895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 622/1229] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.582076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a98de-786b-4b85-98c6-0d47cf0df3a8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.582361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a98de-786b-4b85-98c6-0d47cf0df3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.582636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a98de-786b-4b85-98c6-0d47cf0df3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.586538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-21f4eb66-cd4d-4e79-aa7b-7d1b0c2d9d9c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.587744 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-21f4eb66-cd4d-4e79-aa7b-7d1b0c2d9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.595578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 608/1230] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.596807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.597096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.597365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.601867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-082a98de-786b-4b85-98c6-0d47cf0df3a8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.603230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-082a98de-786b-4b85-98c6-0d47cf0df3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.611882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 623/1231] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.613088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880c13-44eb-4cf2-881a-12d0468ca8bc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.613376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880c13-44eb-4cf2-881a-12d0468ca8bc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.613651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880c13-44eb-4cf2-881a-12d0468ca8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.617569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.618746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.626524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 609/1232] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.627343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.633600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d1880c13-44eb-4cf2-881a-12d0468ca8bc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.634794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d1880c13-44eb-4cf2-881a-12d0468ca8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.637397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e81c73-07ca-40ba-9359-607c1203df68 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.642237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60c071-f8bf-4632-b405-14628146ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.642827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60c071-f8bf-4632-b405-14628146ea98 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.642965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 624/1233] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.643117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60c071-f8bf-4632-b405-14628146ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.643380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60c071-f8bf-4632-b405-14628146ea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.644047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60c071-f8bf-4632-b405-14628146ea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.644150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.644344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.644620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.645785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60c071-f8bf-4632-b405-14628146ea98 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.656388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 610/1234] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:58.657662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947859e-5e77-4390-a3e0-d6fdd984be90 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.657950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947859e-5e77-4390-a3e0-d6fdd984be90 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.658219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947859e-5e77-4390-a3e0-d6fdd984be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.664972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.666184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.674510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 625/1235] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.675302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.677745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1947859e-5e77-4390-a3e0-d6fdd984be90 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.679014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1947859e-5e77-4390-a3e0-d6fdd984be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.686845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 611/1236] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.687437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e012-a660-4e43-a06f-292e94949336 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.688080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.688365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.688632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.694544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.695140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.695438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.695718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.696446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.696661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.698288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.707929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:58.709299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:58.709992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 626/1237] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.710788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.723022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 612/1238] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:58.723992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.727545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a144e-d670-402c-b4a5-353c5f53fb46 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.732441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.733055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.733339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.733634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.734280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.734585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.736220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.736620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f0a8a-6059-4127-a25d-da2ef49ead9a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.742037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.742629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.742906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.743176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.743839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.744142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.745156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:09:58.745156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 13:09:58.745156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 13:09:58.746025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.749514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 627/1239] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.750355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.761930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a7f1-44f1-4b22-ac02-46f373724641 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.762478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 613/1240] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.763273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.766662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.767256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.767573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.767853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.768486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.768818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.770441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.774222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468eeba-684a-4545-96a6-37d0eb144f1c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.778616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.779243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.779648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.779925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] PATH_INFO: `/v3/projects/d6dc0fb4a7ac4d7b8978bb71ca894bb8/users/1abf560b27704e52bc905bf37e274fe9/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.787447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 628/1241] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.787447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.793891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc6bd1-e108-4116-af38-b15a7feda0ab admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.794941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dc0fb4a7ac4d7b8978bb71ca894bb8, user_id=1abf560b27704e52bc905bf37e274fe9, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.797648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.798531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.799118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.799410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.799701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.800331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.800632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.802815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.811101 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 614/1242] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:09:58 2022] PUT /identity/v3/projects/d6dc0fb4a7ac4d7b8978bb71ca894bb8/users/1abf560b27704e52bc905bf37e274fe9/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:09:58.815308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 629/1243] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.816130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.820263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.826787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ecb31-cf28-4a21-9c10-d36ebdd2f0a6 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.847999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:58.856632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:58.884853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce126e9-316c-45df-8865-26c3cb1b0e6e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.886957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.887604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.887888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.888162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.888789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.889532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.889842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:09:58.889842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 13:09:58.889842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 13:09:58.890179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.890404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.890676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.891020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.891313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.891641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.893213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.904700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 615/1244] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:58.912894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.920325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 630/1245] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:58.921066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:58.923386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45fd65-5b4b-48db-875b-9b4396a5ea60 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.983570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.983821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.984072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.984352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.985008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:09:58.985329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.986958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.987074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30940ae7-8f45-458f-ad3c-819b5945f406 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:58.992197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:58.992823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:58.993105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:58.993491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:58.994746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:58.996689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:58.999100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 616/1246] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:09:59.000388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.010327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f35d6-c889-4d21-8885-d2f283b59431 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.015167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177128-03ad-4d2f-9dfe-540db8ea4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.015785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177128-03ad-4d2f-9dfe-540db8ea4347 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.016119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177128-03ad-4d2f-9dfe-540db8ea4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.016402 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177128-03ad-4d2f-9dfe-540db8ea4347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.017026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177128-03ad-4d2f-9dfe-540db8ea4347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.018942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177128-03ad-4d2f-9dfe-540db8ea4347 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.031311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 631/1247] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.031311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.050816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 617/1248] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:58 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.050816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.050816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.050816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.077229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] MFA Rules not processed for user `1abf560b27704e52bc905bf37e274fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:09:59.079156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:09:59.092922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa98619-3aed-43e5-89b8-09223e7da8c5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.137124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:59.143701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 618/1249] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:09:59.144469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.153735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.154352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.154628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.154898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.155557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.157469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.164667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:59.188355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 632/1250] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.188355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.210379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225726e-0779-4d17-8e3a-547f5e4a03ad None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.250907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772cd09-351d-4dbb-ade3-ee78aaaf6e21 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.255759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.256359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.256638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.256903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.257576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.259647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.267943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.268554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.269336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.269757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.271397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.273771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.290063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 633/1251] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.290914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.303377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 619/1252] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.304199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.357050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a979c7-64d6-4c19-a08f-187fc50b2dc1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.367351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d205-4d5d-4883-a10a-85f981037d81 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.372160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.372773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.373182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.373451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.374078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.376027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.404222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 620/1253] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.405012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.416303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.416914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.417203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.417463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.418091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.420047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.431018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:59.443235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 634/1254] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.447149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.447828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:59.456771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628c13-1ffd-4ca4-bb95-5dcce70e7d5b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.471041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3c4a-2dab-4b0b-9e85-4584ca25ca67 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.477682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.477682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.478614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.478614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.479455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.480819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:09:59.480819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 13:09:59.480819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 13:09:59.482060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.504411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 621/1255] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.508188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.513183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.513799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.514078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.514348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.514968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.516927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.517653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af822f3a-9468-4b95-913f-cc743a9f1ab5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.522592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.523165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.523481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.523759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.524400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.526281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.543367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 635/1256] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.543367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.552879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd78c68-ed29-49c0-989c-11d7f7ec9b88 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.558296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 622/1257] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.558296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.561067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.561667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.561955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.562230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.562857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.564844 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.589568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 636/1258] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.589568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.597263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba7f06-2fa6-4007-a47c-1f23011bfd4f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.619786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c18956-3ecc-4239-9118-e0910e24b7ec admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.625179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.625781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.626066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.626325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.626955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.628886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.650824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 623/1259] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.651756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.659532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.660142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.660416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.660683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.661293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cc1ba-8a21-4ad1-bf4a-8adffba15d54 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.661417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.663763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.666576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.667192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.667502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.667779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.668400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.670317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.686303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 637/1260] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.687577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.693148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 624/1261] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.693979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.700174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11cb41-afe9-4558-b2f2-c5b71604f372 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.703215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209701-a635-484f-b8f8-8a3c3e71a639 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.704740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.705359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.705634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.705903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.706577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.708151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.708841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.709275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.709558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.709835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.710585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.712244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.719640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 638/1262] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.722753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.723798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 625/1263] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.724493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.733978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec412-9ba9-40b1-ae5c-0cbcf46784c7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.736316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9c35-cfc3-4a9b-a273-40412ff770ab admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.738572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.739165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.739797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.739797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.740395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.741365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.741950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.742064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.742237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.742502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.743200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.745044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.752015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 639/1264] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.756047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.766756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafdbd-abf9-4e93-a04a-4889b91f1c31 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.769988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 626/1265] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:09:59 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:09:59.771591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.775053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.775699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.775979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.776283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.776899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.778587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.781363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c978-b947-4077-a558-86315b73f5c5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.785892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.786638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.786913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.787209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.787866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.789424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 640/1266] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.789559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.790180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.799429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 627/1267] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.802080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9e6f-7940-4be7-9c46-9dd353bd7707 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.802942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.806518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.807090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.807379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.807668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.808312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.809889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.812201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6c95-b46a-4e5f-b99a-d4552cea2694 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.816683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.817241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.818074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.818353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.818968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.820535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.820639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 641/1268] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.821362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.830962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 628/1269] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.831772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.834602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c51e-1b80-4366-875a-0bb0fed821a2 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.839385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.840093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.840397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.840671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.841357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.841709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b81d3d-852f-4517-9096-a441e9d650d8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.843027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.846629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.847196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.847507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.847775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.848763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.850256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.853775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 642/1270] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.854543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.859502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:59.863126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 629/1271] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.863126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.864714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72048bd7-7eb5-435b-9265-2b01c6cb04f7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.870708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.871598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.871878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.872197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.872861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.873508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66ff2-22c0-4063-a483-7a5997917773 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.874448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.878053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.878625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.878906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.879175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.879831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.882256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.886692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 643/1272] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.888106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.894903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 630/1273] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.894903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.898995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72313-c474-435a-8ded-fb6a23aacfa2 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.899608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:59.903375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fb354-a863-4cd8-84c2-db4ee892df1d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.904558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.905156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.905473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.905791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.906534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.908183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.909329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.910021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.910300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.910568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.911193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.912808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.918323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 644/1274] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.919200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.929948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 631/1275] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.929948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.930185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c7875-acca-4488-96e9-891a08699f06 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.933511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.934085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.934363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.934633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.935257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.936849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.936949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71b40-d03b-4135-bd71-2611fac1456d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.941466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.942031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.942303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.943100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.943743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.945292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.947338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 645/1276] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.947338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.958222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 632/1277] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:09:59.958222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:09:59.960393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9bb9-4b71-43be-b515-fa9dee48fe7f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.964947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.965584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.965865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.966135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] PATH_INFO: `/v3/projects/ed58ea6643854e398cc5add85b90026a/users/6f9396941e5548aebdd1cd5fb4dc9fab/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.967953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb8e7-7d6d-4076-8584-4d0295179101 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:09:59.972532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:09:59.973158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:09:59.973437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:09:59.973708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] PATH_INFO: `/v3/projects/286b1cf90c5344faa0049a1eed43128a/users/506adca00a91411e83a369c937538ee5/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:09:59.980716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed58ea6643854e398cc5add85b90026a, user_id=6f9396941e5548aebdd1cd5fb4dc9fab, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.983378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.989498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] RBAC: Authorizing `identity:create_grant(project_id=286b1cf90c5344faa0049a1eed43128a, user_id=506adca00a91411e83a369c937538ee5, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:09:59.992169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:09:59.997352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 646/1278] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:09:59 2022] PUT /identity/v3/projects/ed58ea6643854e398cc5add85b90026a/users/6f9396941e5548aebdd1cd5fb4dc9fab/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:09:59.998401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.006487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 633/1279] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:09:59 2022] PUT /identity/v3/projects/286b1cf90c5344faa0049a1eed43128a/users/506adca00a91411e83a369c937538ee5/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.007363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.063193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6479a2-6b61-4101-b7cc-86968b809e77 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.068250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.068910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.069188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.069461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] PATH_INFO: `/v3/projects/1cc13b8d594740dba5e0fa92b91a6bd2/users/539c711ce9ef45179be5a9aa893bb7ee/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.070046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146628a-9ab7-47da-87d8-bb4cb129324d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.075587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.076192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.076477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.076762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.077387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.079008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.084026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc13b8d594740dba5e0fa92b91a6bd2, user_id=539c711ce9ef45179be5a9aa893bb7ee, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.086652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.089132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 634/1280] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:00.090221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.100642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b666e1-676b-4ec6-885d-3c2be6ada7f1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.103109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 647/1281] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:09:59 2022] PUT /identity/v3/projects/1cc13b8d594740dba5e0fa92b91a6bd2/users/539c711ce9ef45179be5a9aa893bb7ee/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.106987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.165112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.166138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.166588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.166899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] PATH_INFO: `/v3/projects/b574d0aeb7f64be48dd419f1ef939740/users/9cab4922d88842c8abb73198059029a2/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.179174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f362-9542-45e6-95b4-b5019627b45d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.185177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.185805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b574d0aeb7f64be48dd419f1ef939740, user_id=9cab4922d88842c8abb73198059029a2, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.185937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.186113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.186385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] PATH_INFO: `/v3/projects/93a383a91d5b47c2a482711b1b5dce50/users/019027d6bdd845b59e37401c4fea0e94/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.188554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.203390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a383a91d5b47c2a482711b1b5dce50, user_id=019027d6bdd845b59e37401c4fea0e94, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.203891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 635/1282] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:00 2022] PUT /identity/v3/projects/b574d0aeb7f64be48dd419f1ef939740/users/9cab4922d88842c8abb73198059029a2/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.204818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.206910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.223180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 648/1283] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:00 2022] PUT /identity/v3/projects/93a383a91d5b47c2a482711b1b5dce50/users/019027d6bdd845b59e37401c4fea0e94/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.224353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.244915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:00.246500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:00.270019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f55dcb-b63e-45c8-8150-92fa687801a1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.295838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc2d5-7eb3-40ae-b025-79c83221352d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.300623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347d1b-39d4-4130-93fa-0237260039a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.301289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347d1b-39d4-4130-93fa-0237260039a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.301570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347d1b-39d4-4130-93fa-0237260039a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.301850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347d1b-39d4-4130-93fa-0237260039a6 admin admin] PATH_INFO: `/v3/projects/f579351ceba24bcb8480ab60f21fc553/users/041ce4d1ce1342efa26170f31f2ad185/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.316576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347d1b-39d4-4130-93fa-0237260039a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f579351ceba24bcb8480ab60f21fc553, user_id=041ce4d1ce1342efa26170f31f2ad185, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.319750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347d1b-39d4-4130-93fa-0237260039a6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.326465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dafb1-3a80-4981-98f7-b5411860262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.327199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dafb1-3a80-4981-98f7-b5411860262a admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.327606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dafb1-3a80-4981-98f7-b5411860262a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.327907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dafb1-3a80-4981-98f7-b5411860262a admin admin] PATH_INFO: `/v3/projects/2c6347121ec446cf8796a49289465f12/users/cdcf94479e2f4ca7bdf455dbab82e336/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.333047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 649/1284] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:00 2022] PUT /identity/v3/projects/f579351ceba24bcb8480ab60f21fc553/users/041ce4d1ce1342efa26170f31f2ad185/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.334248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.334527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.334795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.351553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dafb1-3a80-4981-98f7-b5411860262a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6347121ec446cf8796a49289465f12, user_id=cdcf94479e2f4ca7bdf455dbab82e336, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.353699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.354885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dafb1-3a80-4981-98f7-b5411860262a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.355063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.368994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 636/1285] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:00 2022] PUT /identity/v3/projects/2c6347121ec446cf8796a49289465f12/users/cdcf94479e2f4ca7bdf455dbab82e336/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.370866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bdd64-caee-406d-b4bf-98e7cf72766f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.371320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bdd64-caee-406d-b4bf-98e7cf72766f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.371780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bdd64-caee-406d-b4bf-98e7cf72766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.390617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9c3bdd64-caee-406d-b4bf-98e7cf72766f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.391910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9c3bdd64-caee-406d-b4bf-98e7cf72766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.415348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 650/1286] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.416177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.431646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabaf69-4ec0-47cf-a8c2-a9fba84e20dd None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.467052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 637/1287] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.467052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040a88-8f95-40a5-98a9-45868f02d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.467052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040a88-8f95-40a5-98a9-45868f02d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.467052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040a88-8f95-40a5-98a9-45868f02d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.488246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9a040a88-8f95-40a5-98a9-45868f02d5d3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.489503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9a040a88-8f95-40a5-98a9-45868f02d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.498047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 638/1288] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.499303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547858a-d90c-4020-a539-1196417b2fbd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.499616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547858a-d90c-4020-a539-1196417b2fbd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.499886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547858a-d90c-4020-a539-1196417b2fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.507656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3a57d-e549-4aad-82b2-bc0edbf0cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.509150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3a57d-e549-4aad-82b2-bc0edbf0cdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.509523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3a57d-e549-4aad-82b2-bc0edbf0cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.509896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3a57d-e549-4aad-82b2-bc0edbf0cdfb admin admin] PATH_INFO: `/v3/projects/8b760d9b89574c58aab48112120f209b/users/c6efd63e04174a6d880549401e930946/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.529297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3a57d-e549-4aad-82b2-bc0edbf0cdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b760d9b89574c58aab48112120f209b, user_id=c6efd63e04174a6d880549401e930946, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.529474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0547858a-d90c-4020-a539-1196417b2fbd None None] MFA Rules not processed for user `9cab4922d88842c8abb73198059029a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.530492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0547858a-d90c-4020-a539-1196417b2fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.532197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3a57d-e549-4aad-82b2-bc0edbf0cdfb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.547292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 651/1289] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:00 2022] PUT /identity/v3/projects/8b760d9b89574c58aab48112120f209b/users/c6efd63e04174a6d880549401e930946/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:00.548742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ca7-22fb-4a73-8d76-c98577ee1781 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.549535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ca7-22fb-4a73-8d76-c98577ee1781 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.549818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ca7-22fb-4a73-8d76-c98577ee1781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.577235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-af9e9ca7-22fb-4a73-8d76-c98577ee1781 None None] MFA Rules not processed for user `019027d6bdd845b59e37401c4fea0e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.578479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-af9e9ca7-22fb-4a73-8d76-c98577ee1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.582012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:00.583589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:00.601482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 639/1290] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.602631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.602918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.603196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.631370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] MFA Rules not processed for user `041ce4d1ce1342efa26170f31f2ad185`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.632590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.646815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 652/1291] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.650587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.650587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.650587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.668727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.669964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.696594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 640/1292] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.697430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.698669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.752571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 653/1293] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.756533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.757864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.775582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139d86-5bcd-4978-9202-e39c3d40307f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.779237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.779877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.780359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.780635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.789937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.791355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.800915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 641/1294] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:00.802019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.810701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32baa44-d3f0-4f42-bc8b-85cff54a2c45 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.814797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb232ee-6d50-4d40-bf36-f400e582dc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.815380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb232ee-6d50-4d40-bf36-f400e582dc6b service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.815690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb232ee-6d50-4d40-bf36-f400e582dc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.815963 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb232ee-6d50-4d40-bf36-f400e582dc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.816293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44574d38-0eb4-474b-a302-fadfe02ca145 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.820554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.821231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.821579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.821921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.827782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb232ee-6d50-4d40-bf36-f400e582dc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.829846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb232ee-6d50-4d40-bf36-f400e582dc6b service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.834567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:00.836113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:00.840619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 642/1295] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:00.841734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.841734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.841950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.847827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 654/1296] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:00.848861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:00.875546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] MFA Rules not processed for user `c6efd63e04174a6d880549401e930946`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:00.877538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:00.914480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d72520-88e4-477c-bcad-7276105c6dce service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:00.918658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac094d9c-615b-43eb-877e-6f99df4a6073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:00.919427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac094d9c-615b-43eb-877e-6f99df4a6073 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:00.919712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac094d9c-615b-43eb-877e-6f99df4a6073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:00.919985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac094d9c-615b-43eb-877e-6f99df4a6073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:00.925779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:00.981964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:00.990131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 643/1297] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:00.990768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.004173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda162-cb7e-42b2-8b31-8d8372615b8b None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.010318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.010934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.011218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.011542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.012156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.014632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.018090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac094d9c-615b-43eb-877e-6f99df4a6073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.019908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac094d9c-615b-43eb-877e-6f99df4a6073 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.033340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 655/1298] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:01.034864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7efff-5e21-4315-9248-2f1acb48cd87 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.035266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7efff-5e21-4315-9248-2f1acb48cd87 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.035617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7efff-5e21-4315-9248-2f1acb48cd87 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.042602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 656/1299] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 13:10:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:01.043938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7efff-5e21-4315-9248-2f1acb48cd87 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.059541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7efff-5e21-4315-9248-2f1acb48cd87 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.062853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 644/1300] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:00 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:01.063729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.160694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.160694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.160694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.160694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.200337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b7c0-1477-4f87-812e-45e57d6baece admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.211382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38fce7-347e-4ab8-8422-3fa782393ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.213116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fce7-347e-4ab8-8422-3fa782393ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.214168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fce7-347e-4ab8-8422-3fa782393ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.214448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fce7-347e-4ab8-8422-3fa782393ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.215115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fce7-347e-4ab8-8422-3fa782393ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.217076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fce7-347e-4ab8-8422-3fa782393ad0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.269807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 645/1301] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:01 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:01.271155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.271358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.271597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.285823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.287861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.312859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 657/1302] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:01.315570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.350889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feede4-ed65-4b34-8f2d-df68b1b07e4c service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.384496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:01.385743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:01.487245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:01.501001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.502053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.503043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.504196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.505577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.510593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.556272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 646/1303] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:01.560137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.566889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 658/1304] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:01 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:01.570157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.586276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32d53-e6a0-4f02-aa72-90904e3219ca None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.594435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c071adb-0972-4702-a4b7-fcbb031e09bd admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.601464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.601568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.601982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.602341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.602782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.605556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.606084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.606859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.607559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.612503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.676743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 647/1305] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:01 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:01.678830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.698044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.700334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.701741 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bf394-7dd7-4c8f-9a20-5c45e830a018 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.725685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.725685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.725685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.725685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.726133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 659/1306] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:01.726213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.726991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.734035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.750171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2246-8fce-4f61-919b-c9a08e86c970 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.760203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.762006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.762006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.762300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.763639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 648/1307] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:01.767695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.768421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.769786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.789838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 660/1308] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:01.793539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c27aa3-e869-4059-a3ba-05e75dfc1b62 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.794050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.809697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.810520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.810804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.811150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] PATH_INFO: `/v3/projects/dd1284e71ae84913b3a32362442798fb/users/40ec115c366343b5a1991c88c1869ad6/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.815059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4004d3e-4490-4129-bdd9-f5eac30e220a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:01.828438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:01.829124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:01.829404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:01.829680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] PATH_INFO: `/v3/projects/98c57468adb14820bbf21f35a4885362/users/4d797b0c20bc4beeb26b28f614095f7e/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:01.839754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:01.855522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1284e71ae84913b3a32362442798fb, user_id=40ec115c366343b5a1991c88c1869ad6, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.861221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.872008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c57468adb14820bbf21f35a4885362, user_id=4d797b0c20bc4beeb26b28f614095f7e, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:01.878311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:01.880181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 649/1309] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:01 2022] PUT /identity/v3/projects/dd1284e71ae84913b3a32362442798fb/users/40ec115c366343b5a1991c88c1869ad6/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:01.884862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.910473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 661/1310] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:01 2022] PUT /identity/v3/projects/98c57468adb14820bbf21f35a4885362/users/4d797b0c20bc4beeb26b28f614095f7e/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:01.914236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:01.982061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02592869-8d8b-417b-8d06-f649bcccd8a7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:02.062631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d557e-3b85-4211-92fd-c7e3f07c83ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:02.063246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d557e-3b85-4211-92fd-c7e3f07c83ef admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.063556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d557e-3b85-4211-92fd-c7e3f07c83ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.063830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d557e-3b85-4211-92fd-c7e3f07c83ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.064529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d557e-3b85-4211-92fd-c7e3f07c83ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:02.066447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d557e-3b85-4211-92fd-c7e3f07c83ef admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:02.086656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9a8aa-1fb9-4817-9cc4-156efcc37b7c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:02.087794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 650/1311] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:02.089184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70da569-2eb8-4e26-a5ac-fa8f816dd4eb None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.089472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70da569-2eb8-4e26-a5ac-fa8f816dd4eb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.089746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70da569-2eb8-4e26-a5ac-fa8f816dd4eb None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.091575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 651/1312] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 13:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:02.092212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70da569-2eb8-4e26-a5ac-fa8f816dd4eb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:02.108307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c35223-19fa-4f6c-ac24-79b1a5558f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:02.113311 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c35223-19fa-4f6c-ac24-79b1a5558f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.113605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c35223-19fa-4f6c-ac24-79b1a5558f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.113888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c35223-19fa-4f6c-ac24-79b1a5558f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.114701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c35223-19fa-4f6c-ac24-79b1a5558f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:02.116523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c35223-19fa-4f6c-ac24-79b1a5558f50 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:02.128649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70da569-2eb8-4e26-a5ac-fa8f816dd4eb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:02.143607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 662/1313] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:02.143941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:02.144654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.144936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.145232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] PATH_INFO: `/v3/projects/dd1284e71ae84913b3a32362442798fb/users/40ec115c366343b5a1991c88c1869ad6/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.147269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2185cf6-2d68-43bf-bd0d-8b1828e57a82 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.147897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2185cf6-2d68-43bf-bd0d-8b1828e57a82 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.148457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2185cf6-2d68-43bf-bd0d-8b1828e57a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.148828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1284e71ae84913b3a32362442798fb, user_id=40ec115c366343b5a1991c88c1869ad6, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:02.152914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:02.184504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 652/1314] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:02 2022] PUT /identity/v3/projects/dd1284e71ae84913b3a32362442798fb/users/40ec115c366343b5a1991c88c1869ad6/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:02.185595 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:02.192449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e2185cf6-2d68-43bf-bd0d-8b1828e57a82 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:02.195500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e2185cf6-2d68-43bf-bd0d-8b1828e57a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:02.262588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:02.354112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 663/1315] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:02.357496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0b2c-a532-4c01-a52f-fd3701b6a86b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.357656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0b2c-a532-4c01-a52f-fd3701b6a86b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.357941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0b2c-a532-4c01-a52f-fd3701b6a86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.405303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315a8a7-5f73-44cc-8120-002aa4b52a82 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:02.418886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:02.421194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.421863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.423238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] PATH_INFO: `/v3/projects/98c57468adb14820bbf21f35a4885362/users/4d797b0c20bc4beeb26b28f614095f7e/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.429139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c57468adb14820bbf21f35a4885362, user_id=4d797b0c20bc4beeb26b28f614095f7e, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:02.435834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-665c0b2c-a532-4c01-a52f-fd3701b6a86b None None] MFA Rules not processed for user `40ec115c366343b5a1991c88c1869ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:02.437880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:02.439321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-665c0b2c-a532-4c01-a52f-fd3701b6a86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:02.466216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 653/1316] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:02 2022] PUT /identity/v3/projects/98c57468adb14820bbf21f35a4885362/users/4d797b0c20bc4beeb26b28f614095f7e/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:02.467290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:02.499164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:02.591935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 664/1317] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:02.598551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.598551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.600379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.611587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ea4f-25ee-454c-822c-16b23f91a076 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:02.640830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:02.641549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.642506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.642863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:02.669486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] MFA Rules not processed for user `4d797b0c20bc4beeb26b28f614095f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:02.672714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:02.837385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:02.839356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:02.854970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 665/1318] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:02.855979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:02.861766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 654/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:02.891185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a3ff2-be06-4a76-a7d3-a91115ac1c7a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:02.898213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:02.899145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:02.899684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:02.900167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:03.000726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:03.042232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:03.045149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:03.068937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 666/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:03.194695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:03.215166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfc1c8-596d-41ce-b242-882cc7af2280 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:03.226867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab13765-49e8-4eb6-baf0-c36002157076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:03.230949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab13765-49e8-4eb6-baf0-c36002157076 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:03.232018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab13765-49e8-4eb6-baf0-c36002157076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:03.232681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab13765-49e8-4eb6-baf0-c36002157076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:03.266260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab13765-49e8-4eb6-baf0-c36002157076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:03.270144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab13765-49e8-4eb6-baf0-c36002157076 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:03.288365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 655/1321] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:03.400728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:03.582624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4775c8-60d0-48c5-93ae-94b9a90390d1 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:03.592623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:03.593307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:03.593590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:03.593867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] PATH_INFO: `/v3/users/019027d6bdd845b59e37401c4fea0e94` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:03.598255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019027d6bdd845b59e37401c4fea0e94)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:03.599330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: WARNING py.warnings [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:10:03.599330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: warnings.warn(msg) Oct 13 13:10:03.599330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: Oct 13 13:10:03.603516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:03.809861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019027d6bdd845b59e37401c4fea0e94'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:03.810578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019027d6bdd845b59e37401c4fea0e94'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:03.852051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019027d6bdd845b59e37401c4fea0e94'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:03.871368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019027d6bdd845b59e37401c4fea0e94'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:03.872026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-94a0d19d-2fa3-465f-876a-46dff13bb383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019027d6bdd845b59e37401c4fea0e94'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:03.901192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 667/1322] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:03 2022] DELETE /identity/v3/users/019027d6bdd845b59e37401c4fea0e94 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:03.905982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:03.906571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:03.907004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:03.940313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:03.941576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.013386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da4221-ce86-4eed-8171-e225cb20df3e None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.013725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da4221-ce86-4eed-8171-e225cb20df3e None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.013960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da4221-ce86-4eed-8171-e225cb20df3e None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.015889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 668/1323] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 13:10:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:10:04.023994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab0837-2954-4da7-b3dd-23f159016235 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.024275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab0837-2954-4da7-b3dd-23f159016235 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.024553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab0837-2954-4da7-b3dd-23f159016235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.088556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1dab0837-2954-4da7-b3dd-23f159016235 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:04.089810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1dab0837-2954-4da7-b3dd-23f159016235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.165774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 656/1324] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:04.225538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:04.227265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.280819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:04.321478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 669/1325] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 13 13:10:04.327042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18716-8313-4f83-9c1f-2a040d470913 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.327658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18716-8313-4f83-9c1f-2a040d470913 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.327658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18716-8313-4f83-9c1f-2a040d470913 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.329740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 670/1326] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 13:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:04.335130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.335564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.335743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.370063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:04.391503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a77ac-d85e-45bc-b2bc-1ac6b64b168c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:04.397061 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:04.398127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.398684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.399201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.400624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:04.401880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.415219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:04.418743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:04.438043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 657/1327] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:04.439506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 671/1328] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:04.461514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:04.463391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.597494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:04.598925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.606257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6cc1-a9df-46f3-b5af-da938079d01c service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:04.611276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:04.611940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.612223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.612498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.625960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:04.627699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:04.634388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7eaab-7b14-4839-8016-81eddb9dd5a8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:04.642380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 658/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:04.653731 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:04.654398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:04.660069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:04.661563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:04.671108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:04.887994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:04.889475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:04.924762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 672/1330] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:05.268015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:05.270678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:05.303183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7096a4a-8d24-40e5-ac78-360fdbad55eb service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:05.319538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:05.322031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:05.322876 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:05.324782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] PATH_INFO: `/v3/projects/93a383a91d5b47c2a482711b1b5dce50` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:05.327091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a383a91d5b47c2a482711b1b5dce50)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:05.328800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: WARNING py.warnings [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 13:10:05.328800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: warnings.warn(msg) Oct 13 13:10:05.328800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: Oct 13 13:10:05.331567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:05.392742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:05.392742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:05.415113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bb849-ce4c-4d85-82cf-ccfa7d5b60e3 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:05.501392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a383a91d5b47c2a482711b1b5dce50', 'request_id': 'req-c340d77f-addc-486d-a75b-60aa37aeb265'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.545255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a383a91d5b47c2a482711b1b5dce50', 'request_id': 'req-c340d77f-addc-486d-a75b-60aa37aeb265'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.548901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:05.549560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:05.549891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:05.550170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] PATH_INFO: `/v3/users/041ce4d1ce1342efa26170f31f2ad185` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:05.555323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=041ce4d1ce1342efa26170f31f2ad185)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:05.558419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:05.571812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a383a91d5b47c2a482711b1b5dce50', 'request_id': 'req-c340d77f-addc-486d-a75b-60aa37aeb265'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.607772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] The token cache is being invalidate because project 93a383a91d5b47c2a482711b1b5dce50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:05.608326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.610666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.614952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 659/1331] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:05 2022] DELETE /identity/v3/projects/93a383a91d5b47c2a482711b1b5dce50 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:05.632946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:05.635120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:05.675606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340d77f-addc-486d-a75b-60aa37aeb265 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:05.681971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041ce4d1ce1342efa26170f31f2ad185'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.683256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041ce4d1ce1342efa26170f31f2ad185'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.695138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:05.699263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:05.702934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:05.703391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] PATH_INFO: `/v3/users/40ec115c366343b5a1991c88c1869ad6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:05.704476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041ce4d1ce1342efa26170f31f2ad185'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.706119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ec115c366343b5a1991c88c1869ad6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:05.715559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:05.720086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041ce4d1ce1342efa26170f31f2ad185'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.721264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-42f25d9e-4108-4bc3-b0a7-38c17bbdc0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041ce4d1ce1342efa26170f31f2ad185'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.744101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 673/1332] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:05 2022] DELETE /identity/v3/users/041ce4d1ce1342efa26170f31f2ad185 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:05.749131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:05.749482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:05.749892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:05.773326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:05.804632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:05.806499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:05.838294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ec115c366343b5a1991c88c1869ad6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.860745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ec115c366343b5a1991c88c1869ad6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.892831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:05.907239 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ec115c366343b5a1991c88c1869ad6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.908066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ec115c366343b5a1991c88c1869ad6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.923202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ec115c366343b5a1991c88c1869ad6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:05.936360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 660/1333] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:05 2022] DELETE /identity/v3/users/40ec115c366343b5a1991c88c1869ad6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:06.162389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 674/1334] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:06.172678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:06.175586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:06.347590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8293330-970f-465d-9053-7e065635e53e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:06.367147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074818e7-db8e-4a06-9719-24d9cb7ab3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:06.367817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074818e7-db8e-4a06-9719-24d9cb7ab3cf service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:06.368104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074818e7-db8e-4a06-9719-24d9cb7ab3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:06.368747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074818e7-db8e-4a06-9719-24d9cb7ab3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:06.487009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074818e7-db8e-4a06-9719-24d9cb7ab3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:06.491897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074818e7-db8e-4a06-9719-24d9cb7ab3cf service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:06.510702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 661/1335] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:08.233578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:08.235624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:08.261639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c08b7d-1fae-442d-b00d-0c8a4f065bfc None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:08.292119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:08.293057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:08.297004 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:08.298756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] PATH_INFO: `/v3/projects/dd1284e71ae84913b3a32362442798fb` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:08.304716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1284e71ae84913b3a32362442798fb)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:08.312550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:08.471525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1284e71ae84913b3a32362442798fb', 'request_id': 'req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:08.489670 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1284e71ae84913b3a32362442798fb', 'request_id': 'req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:08.505720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1284e71ae84913b3a32362442798fb', 'request_id': 'req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:08.541634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] The token cache is being invalidate because project dd1284e71ae84913b3a32362442798fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:08.542146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:08.542898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8cca3fbb-581a-4440-ae18-8f5ad5ad81ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:08.550536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 675/1336] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:08 2022] DELETE /identity/v3/projects/dd1284e71ae84913b3a32362442798fb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:08.552195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:08.553342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:08.553342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:08.613822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:08.616176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:08.849081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 662/1337] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:08.859763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:08.860242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:08.860406 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:08.909482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:08.910790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:08.958059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 676/1338] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:08.962721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:08.980209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ef748-ae2e-41a6-8d2f-bcca1e6d6e6c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:09.008353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:09.008998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.009284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.009562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.010234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:09.010542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:09.012270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:09.055546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 663/1339] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:10:09.059990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:09.079924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14fa42-4276-42fe-87fe-9c3685e621aa None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:09.096686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:09.097314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.097586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.097857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.098507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:09.101300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:09.221252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 677/1340] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:09 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:09.226227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:09.241102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e64b4-e9cd-4dc7-bc69-dfe52cbcea1c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:09.302884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:09.398606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:09.399242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.399550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.400027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.400838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:09.402962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:09.478621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 664/1341] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:09 2022] POST /identity/v3/users => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:09.483192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:09.499759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934eb8-a0a8-41ee-829a-16c54e3c3410 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:09.505177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:09.507546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.508915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.511882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.513022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:09.515351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:09.535961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 678/1342] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:09.539788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:09.557397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cfefc-7098-4fbc-be9d-497f3a64f9f3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:09.563999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309268e-cfa3-440c-903b-8248648d0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:09.564890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309268e-cfa3-440c-903b-8248648d0439 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.565486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309268e-cfa3-440c-903b-8248648d0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.565964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309268e-cfa3-440c-903b-8248648d0439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.566863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309268e-cfa3-440c-903b-8248648d0439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:09.569569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309268e-cfa3-440c-903b-8248648d0439 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:09.586996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 665/1343] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:09.590871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:09.608484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b64bd-60de-4bcc-92e3-cb4e7bc5d348 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:09.626302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:09.627450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.630872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.631442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] PATH_INFO: `/v3/projects/ca544d3a6fce409b8a32a31dd9b937fb/users/a3c8f28577a246d6a03dbad42dfe8559/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.685607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca544d3a6fce409b8a32a31dd9b937fb, user_id=a3c8f28577a246d6a03dbad42dfe8559, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:09.689070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:09.740360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 679/1344] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:09 2022] PUT /identity/v3/projects/ca544d3a6fce409b8a32a31dd9b937fb/users/a3c8f28577a246d6a03dbad42dfe8559/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:09.751013 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:09.751354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:09.751849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:09.844816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] MFA Rules not processed for user `a3c8f28577a246d6a03dbad42dfe8559`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:09.846376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.017089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 666/1345] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:10.018117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.074748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:10.166901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5bc1-4774-4365-9e51-9ef12d171f93 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.182090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.182825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.183286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.183598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.184265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.190471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.208670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.210456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.241693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a86c-311c-4ba6-bbbc-3d731d097c6e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.260027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.260784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.261135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.261478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] PATH_INFO: `/v3/projects/f579351ceba24bcb8480ab60f21fc553` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.262911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f579351ceba24bcb8480ab60f21fc553)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.265224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.272135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 680/1346] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:10 2022] POST /identity/v3/projects => generated 399 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:10.275386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.370729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f579351ceba24bcb8480ab60f21fc553', 'request_id': 'req-3d0b8091-b4ae-495e-a05d-8da9ffb12433'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:10.390116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f579351ceba24bcb8480ab60f21fc553', 'request_id': 'req-3d0b8091-b4ae-495e-a05d-8da9ffb12433'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:10.410665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f579351ceba24bcb8480ab60f21fc553', 'request_id': 'req-3d0b8091-b4ae-495e-a05d-8da9ffb12433'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:10.441858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] The token cache is being invalidate because project f579351ceba24bcb8480ab60f21fc553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:10.442211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:10.447005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3d0b8091-b4ae-495e-a05d-8da9ffb12433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:10.452223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 667/1347] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:10 2022] DELETE /identity/v3/projects/f579351ceba24bcb8480ab60f21fc553 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:10.453868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.454380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.454566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.473373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f053e29-233d-47ab-8ac0-2c7bdc3bafb4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.532756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:10.538793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.556611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:10.612014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.612630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.612910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.613183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.613824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.616385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.661685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 681/1348] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:10 2022] POST /identity/v3/users => generated 306 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:10.667213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.669167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.733378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 668/1349] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:10.734326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.736014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.751291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db538a5-95ca-4db9-b4c1-d1ee5cdb7763 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.762875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba595f-5bad-4952-b073-ebbf16e6fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.765354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba595f-5bad-4952-b073-ebbf16e6fbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.765660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba595f-5bad-4952-b073-ebbf16e6fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.765947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba595f-5bad-4952-b073-ebbf16e6fbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.766622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba595f-5bad-4952-b073-ebbf16e6fbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.770867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba595f-5bad-4952-b073-ebbf16e6fbe6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.786452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:10.798301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 669/1350] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:10.807084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.809517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.809803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.810567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32962ea-ddfe-4049-be8d-dbf5e174a7fa admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.818075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.818917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.819129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.819541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.821755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.857929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:10.859746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:10.880869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 670/1351] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:10.880869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.904440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6845643-1cf8-4b9c-b8b0-34510d9c9d06 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.909808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.912786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.918057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.918502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.918785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.919431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] PATH_INFO: `/v3/projects/9548939f75fc4a1da3b34275b4e25f45/users/ff0365cb253c409ea4c0abb0ac72cc1f/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.927140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 682/1352] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:10.928651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:10.943725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536040a-97c7-4839-af2c-ba8bc515744a service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:10.951385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:10.952588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:10.953156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:10.953628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:10.954571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:10.955075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.957823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.980817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9548939f75fc4a1da3b34275b4e25f45, user_id=ff0365cb253c409ea4c0abb0ac72cc1f, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:10.991226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:10.993044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 683/1353] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:10.995539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.012652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534affdf-0bd4-4944-8f8f-3abf628c86ab admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.026020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 671/1354] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:10 2022] PUT /identity/v3/projects/9548939f75fc4a1da3b34275b4e25f45/users/ff0365cb253c409ea4c0abb0ac72cc1f/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:11.033019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.134737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.135430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.135963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.135963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.136557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.138481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.209949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 684/1355] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:10 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:11.214338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.234426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08563c73-6d57-4314-b6bd-a94d41c3c483 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.373904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.374537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.375434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.375434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.377300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.378468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.393423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd78a9-0179-402c-aacc-2f17936b7dfb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.401497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 672/1356] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:11.408499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.419431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.422507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.423038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.423380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.424243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.428510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.429276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17673a-a20d-40af-a3f7-da83e2f709f3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.448897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e020054-540c-448f-bc95-bb68935d3c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.448897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e020054-540c-448f-bc95-bb68935d3c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.448897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e020054-540c-448f-bc95-bb68935d3c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.448897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e020054-540c-448f-bc95-bb68935d3c1c admin admin] PATH_INFO: `/v3/projects/9548939f75fc4a1da3b34275b4e25f45/users/ff0365cb253c409ea4c0abb0ac72cc1f/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.455734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e020054-540c-448f-bc95-bb68935d3c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9548939f75fc4a1da3b34275b4e25f45, user_id=ff0365cb253c409ea4c0abb0ac72cc1f, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.470052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:11.472244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e020054-540c-448f-bc95-bb68935d3c1c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.484790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 685/1357] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:11 2022] POST /identity/v3/users => generated 286 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:11.486396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.501543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:11.511272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482a367-cd19-475a-acf2-50925cf12aed admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.525315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 673/1358] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:11 2022] PUT /identity/v3/projects/9548939f75fc4a1da3b34275b4e25f45/users/ff0365cb253c409ea4c0abb0ac72cc1f/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:11.530870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.531815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.535531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.649780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] MFA Rules not processed for user `ff0365cb253c409ea4c0abb0ac72cc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:11.656293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:11.711037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.711711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.711996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.712350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.712922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.714873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.755250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 686/1359] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:11.762929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.799671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93001-ac2f-4e90-a9a6-ef02d368e612 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.824059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.828116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.828528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.828887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.830687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.834151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.887610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 687/1360] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:11.889237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.924340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488854d8-74d1-41f9-9578-4205bf4c27f7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:11.938687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127a38f-a4c9-4038-bc2b-1de65101940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:11.939733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127a38f-a4c9-4038-bc2b-1de65101940e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:11.940228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127a38f-a4c9-4038-bc2b-1de65101940e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:11.940715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127a38f-a4c9-4038-bc2b-1de65101940e admin admin] PATH_INFO: `/v3/projects/083c2d77e9c74427bea8b143e294e5d7/users/02d2c063b69d4a5ba9e87a6db8753727/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:11.979448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 674/1361] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:11.982212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127a38f-a4c9-4038-bc2b-1de65101940e admin admin] RBAC: Authorizing `identity:create_grant(project_id=083c2d77e9c74427bea8b143e294e5d7, user_id=02d2c063b69d4a5ba9e87a6db8753727, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:11.989125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127a38f-a4c9-4038-bc2b-1de65101940e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:11.989309 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:11.991718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:12.018685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 688/1362] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:11 2022] PUT /identity/v3/projects/083c2d77e9c74427bea8b143e294e5d7/users/02d2c063b69d4a5ba9e87a6db8753727/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:12.033857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:12.034166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:12.034416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:12.115032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] MFA Rules not processed for user `02d2c063b69d4a5ba9e87a6db8753727`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:12.116325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:12.152854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dd6ad-a72d-4976-8ec1-a3f130882bd3 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:12.306429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 689/1363] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:12.306654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:12.306654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:12.307497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:12.308149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:12.308434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:12.442459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:12.464220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:12.479914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f061-9a4b-47df-8943-5063d9430fb9 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:12.485846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:12.485846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:12.486534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:12.486940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:12.488393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:12.495125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:12.502842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:12.507105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:12.535917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 675/1364] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:12.558742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 690/1365] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:12.562344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:12.578680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e1bf-da3e-42cf-a224-f1410c8c2fa2 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:12.708027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:12.766133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:12.773754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:12.776504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:12.777713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:12.780531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:12.789459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:12.845595 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 676/1366] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:12 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:12.848174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:12.866143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bd7ba-5ef2-40e3-8dce-786f0d069952 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:12.874864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:12.875549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:12.875830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:12.876106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:12.884339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:12.887309 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07198b-161e-4c6f-bded-f8fae0f1b141 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:12.901795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826704-2146-439b-8ca4-287496445aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:12.902442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826704-2146-439b-8ca4-287496445aed admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:12.902726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826704-2146-439b-8ca4-287496445aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:12.903015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826704-2146-439b-8ca4-287496445aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:12.911647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49826704-2146-439b-8ca4-287496445aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:12.915848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49826704-2146-439b-8ca4-287496445aed admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:12.956369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 677/1367] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:12.961988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826704-2146-439b-8ca4-287496445aed admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:13.001485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826704-2146-439b-8ca4-287496445aed admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:13.041025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:13.044284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:13.045765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:13.046112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] PATH_INFO: `/v3/projects/1efc388b8c364d0eb88c84787ac3871e/users/6fe14c7655424ab898994609e8f48fcd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:13.097263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:13.101496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:13.106389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efc388b8c364d0eb88c84787ac3871e, user_id=6fe14c7655424ab898994609e8f48fcd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:13.116551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:13.129416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 691/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:13.155706 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 678/1369] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:12 2022] PUT /identity/v3/projects/1efc388b8c364d0eb88c84787ac3871e/users/6fe14c7655424ab898994609e8f48fcd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:13.160144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:13.181529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70784-7144-4e81-9da4-4b3902669b0e service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:13.320506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cb2cd-cc60-4539-b02a-dd463253ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:13.321429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb2cd-cc60-4539-b02a-dd463253ffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:13.323014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb2cd-cc60-4539-b02a-dd463253ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:13.323343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb2cd-cc60-4539-b02a-dd463253ffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:13.325366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb2cd-cc60-4539-b02a-dd463253ffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:13.330374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb2cd-cc60-4539-b02a-dd463253ffd3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:13.365814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 692/1370] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:13.370416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:13.389416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbcd19-ba52-4871-bab1-7c8155e979e2 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:13.402539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:13.403199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:13.403532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:13.403815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] PATH_INFO: `/v3/projects/1efc388b8c364d0eb88c84787ac3871e/users/6fe14c7655424ab898994609e8f48fcd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:13.421044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efc388b8c364d0eb88c84787ac3871e, user_id=6fe14c7655424ab898994609e8f48fcd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:13.429265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:13.464410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 679/1371] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:13 2022] PUT /identity/v3/projects/1efc388b8c364d0eb88c84787ac3871e/users/6fe14c7655424ab898994609e8f48fcd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:13.466515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:13.466515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:13.466738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:13.549028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] MFA Rules not processed for user `6fe14c7655424ab898994609e8f48fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:13.552952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:13.584729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:13.760620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 693/1372] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:13.797049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:14.052107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256c4e-d106-441e-adc1-26fcea343819 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:14.071912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:14.073905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:14.077116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:14.078191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:14.112117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:14.117562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:14.166435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 680/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:14.368326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:14.397574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:14.397861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e1a6-1126-4b31-a63d-b242ae7e74f6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:14.399801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:14.410990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3dbd4-2b78-402d-a05e-f33dac8e09be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:14.411903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3dbd4-2b78-402d-a05e-f33dac8e09be service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:14.412909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3dbd4-2b78-402d-a05e-f33dac8e09be service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:14.413347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3dbd4-2b78-402d-a05e-f33dac8e09be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:14.522669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:14.604573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fa57d-d026-43b2-abb0-4a97b411ddfb service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:14.606637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3dbd4-2b78-402d-a05e-f33dac8e09be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:14.608419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3dbd4-2b78-402d-a05e-f33dac8e09be service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:14.615297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:14.616850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:14.618774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:14.619302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] PATH_INFO: `/v3/users/9cab4922d88842c8abb73198059029a2` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:14.623671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cab4922d88842c8abb73198059029a2)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:14.629573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:14.647351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 694/1374] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:14.868916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cab4922d88842c8abb73198059029a2'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:14.893716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cab4922d88842c8abb73198059029a2'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:14.967433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cab4922d88842c8abb73198059029a2'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:14.968333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cab4922d88842c8abb73198059029a2'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:14.983324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cab4922d88842c8abb73198059029a2'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:15.000655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 681/1375] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:14 2022] DELETE /identity/v3/users/9cab4922d88842c8abb73198059029a2 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:15.004950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:15.005456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:15.006361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:15.063993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:15.069326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:15.271299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 695/1376] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:15.362452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:15.367525 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:15.418244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:15.419795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:15.440064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586366-54f7-44ce-83d3-4f745d5164aa None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:15.460985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:15.462227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:15.466513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:15.466913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] PATH_INFO: `/v3/users/1abf560b27704e52bc905bf37e274fe9` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:15.468635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abf560b27704e52bc905bf37e274fe9)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:15.479312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:15.557176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8d419-866f-49a7-b3ec-21176f434b62 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:15.572948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c9bf6-d5c7-40f8-98f2-04f4b1718026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:15.577151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c9bf6-d5c7-40f8-98f2-04f4b1718026 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:15.578822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c9bf6-d5c7-40f8-98f2-04f4b1718026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:15.579128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c9bf6-d5c7-40f8-98f2-04f4b1718026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:15.590992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:15.598255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abf560b27704e52bc905bf37e274fe9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:15.601679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abf560b27704e52bc905bf37e274fe9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:15.610668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c9bf6-d5c7-40f8-98f2-04f4b1718026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:15.618086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c9bf6-d5c7-40f8-98f2-04f4b1718026 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:15.646155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abf560b27704e52bc905bf37e274fe9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:15.653887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 682/1377] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:15.673251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abf560b27704e52bc905bf37e274fe9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:15.674280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abf560b27704e52bc905bf37e274fe9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:15.705447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 696/1378] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:15 2022] DELETE /identity/v3/users/1abf560b27704e52bc905bf37e274fe9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:15.707889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f1958-308b-439b-bb31-58684cb9e5c4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:15.707889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f1958-308b-439b-bb31-58684cb9e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:15.708178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f1958-308b-439b-bb31-58684cb9e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:15.766589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ad1f1958-308b-439b-bb31-58684cb9e5c4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:15.796663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ad1f1958-308b-439b-bb31-58684cb9e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:15.967074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:16.008924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 683/1379] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:16.039059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:16.040585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:16.075128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6ff0-4bfc-4ae8-97d7-003e2122c1ba None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:16.075447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6ff0-4bfc-4ae8-97d7-003e2122c1ba None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:16.075727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6ff0-4bfc-4ae8-97d7-003e2122c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:16.141702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9e7e6ff0-4bfc-4ae8-97d7-003e2122c1ba None None] MFA Rules not processed for user `506adca00a91411e83a369c937538ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:16.142935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9e7e6ff0-4bfc-4ae8-97d7-003e2122c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:16.231016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3853c-9f08-42bd-8dd2-9b782763e77f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:16.243362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:16.244038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:16.244318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:16.244590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:16.265148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:16.280563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:16.339576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 697/1380] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:16.377194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 684/1381] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:16.391183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:16.393003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:16.581724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f97a9e-f0e3-4f05-99a0-02e5c5cb3100 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:16.598403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a551-5e7b-436e-86ce-fbeb6e5c967c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:16.599284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a551-5e7b-436e-86ce-fbeb6e5c967c service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:16.600919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a551-5e7b-436e-86ce-fbeb6e5c967c service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:16.602800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a551-5e7b-436e-86ce-fbeb6e5c967c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:16.626921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a551-5e7b-436e-86ce-fbeb6e5c967c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:16.637085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a551-5e7b-436e-86ce-fbeb6e5c967c service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:16.642801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:16.643135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:16.643375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:16.657617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 698/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:16.759852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] MFA Rules not processed for user `539c711ce9ef45179be5a9aa893bb7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:16.761104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:17.046684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 685/1383] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:17.060885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:17.061394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:17.061678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:17.133688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] MFA Rules not processed for user `539c711ce9ef45179be5a9aa893bb7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:17.134950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:17.172047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 699/1384] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:17.195150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:17.196748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:17.248117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c1de-9237-440e-8cf3-dc329ba0d271 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:17.274224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887619a-269d-40db-be38-a2e9a000f996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:17.274873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887619a-269d-40db-be38-a2e9a000f996 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:17.290634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887619a-269d-40db-be38-a2e9a000f996 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:17.290947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887619a-269d-40db-be38-a2e9a000f996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:17.310898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887619a-269d-40db-be38-a2e9a000f996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:17.327721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887619a-269d-40db-be38-a2e9a000f996 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:17.405121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 686/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:17.409553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:17.410771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:17.436904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a34ac-7475-4d93-b1d7-f329d5c618d3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:17.448899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:17.449753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:17.450034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:17.450378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] PATH_INFO: `/v3/projects/b574d0aeb7f64be48dd419f1ef939740` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:17.453802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b574d0aeb7f64be48dd419f1ef939740)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:17.458653 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:17.555155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:17.577968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b574d0aeb7f64be48dd419f1ef939740', 'request_id': 'req-3dc3c6cb-f2f7-492d-a818-b4870637496d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:17.603555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b574d0aeb7f64be48dd419f1ef939740', 'request_id': 'req-3dc3c6cb-f2f7-492d-a818-b4870637496d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:17.637225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b574d0aeb7f64be48dd419f1ef939740', 'request_id': 'req-3dc3c6cb-f2f7-492d-a818-b4870637496d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:17.670218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] The token cache is being invalidate because project b574d0aeb7f64be48dd419f1ef939740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:17.670519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:17.672827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3dc3c6cb-f2f7-492d-a818-b4870637496d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:17.681206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 700/1386] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:17 2022] DELETE /identity/v3/projects/b574d0aeb7f64be48dd419f1ef939740 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:17.683116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:17.683500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:17.683883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:17.768674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:17.771210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:17.927442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 687/1387] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:17.930977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:17.931317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:17.931661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:17.959744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:17.961002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:18.029666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 701/1388] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:18.030725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:18.042248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:18.049821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:18.054939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:18.055114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69888b-2ed2-4e9a-80a7-ffebd6713836 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:18.068760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:18.069630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.070135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.070844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.072766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:18.074262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:18.076106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4184d3-a419-40c3-8fb4-ac95f6948e9e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:18.081467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1a6f-32c6-46ff-9c9f-a76441df88bd None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:18.126139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:18.126139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.129607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.130958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] PATH_INFO: `/v3/projects/d6dc0fb4a7ac4d7b8978bb71ca894bb8` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.140104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 688/1389] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:18.141868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6dc0fb4a7ac4d7b8978bb71ca894bb8)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:18.142851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.142851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.143014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.148330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:18.220380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] MFA Rules not processed for user `6f9396941e5548aebdd1cd5fb4dc9fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:18.224778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:18.276999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6dc0fb4a7ac4d7b8978bb71ca894bb8', 'request_id': 'req-fcd506da-eb16-4f87-b595-7fa5032331de'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.297649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6dc0fb4a7ac4d7b8978bb71ca894bb8', 'request_id': 'req-fcd506da-eb16-4f87-b595-7fa5032331de'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.322905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6dc0fb4a7ac4d7b8978bb71ca894bb8', 'request_id': 'req-fcd506da-eb16-4f87-b595-7fa5032331de'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.358774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] The token cache is being invalidate because project d6dc0fb4a7ac4d7b8978bb71ca894bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:18.359264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.360144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.367357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 702/1390] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:18 2022] DELETE /identity/v3/projects/d6dc0fb4a7ac4d7b8978bb71ca894bb8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:18.368769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:18.370324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:18.403508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 689/1391] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:18.403508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:18.448221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1657217-6437-4ff2-b8bc-4c8d9010109a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:18.491885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd506da-eb16-4f87-b595-7fa5032331de admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:18.498662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e950fa-7afc-4bba-8407-e9e604160094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:18.499022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e950fa-7afc-4bba-8407-e9e604160094 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.499348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e950fa-7afc-4bba-8407-e9e604160094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.499850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e950fa-7afc-4bba-8407-e9e604160094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.500293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e950fa-7afc-4bba-8407-e9e604160094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:18.502436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e950fa-7afc-4bba-8407-e9e604160094 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:18.556388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 703/1392] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:18 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:18.558914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7728-07d5-4da4-8609-a53fee0a5832 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.560389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7728-07d5-4da4-8609-a53fee0a5832 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.560856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7728-07d5-4da4-8609-a53fee0a5832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.616775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7bba7728-07d5-4da4-8609-a53fee0a5832 None None] MFA Rules not processed for user `6f9396941e5548aebdd1cd5fb4dc9fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:18.618461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7bba7728-07d5-4da4-8609-a53fee0a5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:18.625091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:18.626846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.628153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.628701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] PATH_INFO: `/v3/users/c6efd63e04174a6d880549401e930946` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.630366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6efd63e04174a6d880549401e930946)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:18.635213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:18.692205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:18.761650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6efd63e04174a6d880549401e930946'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.787217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 704/1393] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:18.788677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735e151-5df5-45b5-80ae-f4c068c1b197 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:18.788965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735e151-5df5-45b5-80ae-f4c068c1b197 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:18.789237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735e151-5df5-45b5-80ae-f4c068c1b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:18.790954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6efd63e04174a6d880549401e930946'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.821894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6efd63e04174a6d880549401e930946'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.822807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6efd63e04174a6d880549401e930946'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.832686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6efd63e04174a6d880549401e930946'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:18.835835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:18.853531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-0735e151-5df5-45b5-80ae-f4c068c1b197 None None] MFA Rules not processed for user `cdcf94479e2f4ca7bdf455dbab82e336`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:18.854876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0735e151-5df5-45b5-80ae-f4c068c1b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:18.858019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 690/1394] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:18 2022] DELETE /identity/v3/users/c6efd63e04174a6d880549401e930946 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:18.866428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:18.868072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.037757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 705/1395] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:19.039898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230ff90-224e-4798-a080-624b12f7932f None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.042360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230ff90-224e-4798-a080-624b12f7932f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.047122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230ff90-224e-4798-a080-624b12f7932f None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.050800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 706/1396] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 13:10:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:19.051778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230ff90-224e-4798-a080-624b12f7932f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.058205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b230ff90-224e-4798-a080-624b12f7932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.108844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d3f06-fe76-463b-85d2-10fbeebb462d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.120296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955ba5c-333f-409c-88a8-18c4b9b8afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.120926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955ba5c-333f-409c-88a8-18c4b9b8afba admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.124102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955ba5c-333f-409c-88a8-18c4b9b8afba admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.124439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955ba5c-333f-409c-88a8-18c4b9b8afba admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.125112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955ba5c-333f-409c-88a8-18c4b9b8afba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.129424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955ba5c-333f-409c-88a8-18c4b9b8afba admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.177412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 691/1397] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:18 2022] POST /identity/v3/users => generated 291 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:19.180119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.180403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.180678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.262435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230ff90-224e-4798-a080-624b12f7932f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.280118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.280746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.281019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.281287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.286125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] MFA Rules not processed for user `0fd9d9e53d0f4a2ca149de05ff08d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:19.288376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.289751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.443043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 692/1398] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:10:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:19.452986 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.465466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.467430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.475903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:19.480629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468f6c3-d3fb-4566-866a-4644ae6300dc None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.494366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.495282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.495723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.506357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.509266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.514311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.520310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 707/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:19.521475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.529248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.543982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 693/1400] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:19.545085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.552220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.561861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0d02d-dede-496d-8658-96539cc1002c service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.567259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.568179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.568684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.569132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] PATH_INFO: `/v3/users/a3c8f28577a246d6a03dbad42dfe8559` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.571679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c8f28577a246d6a03dbad42dfe8559)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.573720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.580048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e3683-78c8-43b6-acca-bbf71dd32d10 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.597499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.598134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.598423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.598686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.617154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.619715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.641122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 694/1401] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:19.642014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.649969 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.663342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c8f28577a246d6a03dbad42dfe8559'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.664865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c8f28577a246d6a03dbad42dfe8559'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.681632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449a9f7-88cd-4fac-9990-42fb1f617a4d service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.685448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c8f28577a246d6a03dbad42dfe8559'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.694711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.695459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.695808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.696086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] PATH_INFO: `/v3/projects/8b760d9b89574c58aab48112120f209b` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.696693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c8f28577a246d6a03dbad42dfe8559'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.699017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c8f28577a246d6a03dbad42dfe8559'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.699123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b760d9b89574c58aab48112120f209b)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.703437 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.737329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 708/1402] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:19 2022] DELETE /identity/v3/users/a3c8f28577a246d6a03dbad42dfe8559 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:19.742076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.745177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.818256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b760d9b89574c58aab48112120f209b', 'request_id': 'req-4101513e-3219-4cdc-921d-eee9937808bb'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.827933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b760d9b89574c58aab48112120f209b', 'request_id': 'req-4101513e-3219-4cdc-921d-eee9937808bb'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.830990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:19.841680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b760d9b89574c58aab48112120f209b', 'request_id': 'req-4101513e-3219-4cdc-921d-eee9937808bb'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.852845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a421f-21b5-45da-b066-c945925975e6 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:19.866449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] The token cache is being invalidate because project 8b760d9b89574c58aab48112120f209b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:19.866665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.867968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4101513e-3219-4cdc-921d-eee9937808bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:19.871644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 695/1403] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:19 2022] DELETE /identity/v3/projects/8b760d9b89574c58aab48112120f209b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:19.872884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.873169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.873442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.920475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:19.925127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:19.959922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:19.960552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:19.960828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:19.961095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:19.961751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:19.963360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:19.990082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 709/1404] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:19.991175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:19.995243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.034689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570eef-2f4d-49a2-9100-baf31f60ba41 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:20.049657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:20.050651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:20.050988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:20.051265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] PATH_INFO: `/v3/users/4d797b0c20bc4beeb26b28f614095f7e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:20.055606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d797b0c20bc4beeb26b28f614095f7e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:20.060940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:20.094867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:20.115801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 696/1405] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:20.119730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:20.124140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.164349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d2639-0833-4834-8dcc-a24c3d212985 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:20.182002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:20.182151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:20.183829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:20.184259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] PATH_INFO: `/v3/projects/d78dbb9576ae4035bd4a5f9ed09f967f/users/0e702b55ea1442febb8eafe11fb2b598/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:20.203714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d797b0c20bc4beeb26b28f614095f7e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:20.204619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d797b0c20bc4beeb26b28f614095f7e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:20.227680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d797b0c20bc4beeb26b28f614095f7e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:20.242868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78dbb9576ae4035bd4a5f9ed09f967f, user_id=0e702b55ea1442febb8eafe11fb2b598, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:20.245748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d797b0c20bc4beeb26b28f614095f7e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:20.246069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:20.246629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-54a39546-a6bc-455a-929e-166cd6f1ae3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d797b0c20bc4beeb26b28f614095f7e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:20.280015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 697/1406] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:20 2022] PUT /identity/v3/projects/d78dbb9576ae4035bd4a5f9ed09f967f/users/0e702b55ea1442febb8eafe11fb2b598/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:20.283932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:20.287736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.298391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 710/1407] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:19 2022] DELETE /identity/v3/users/4d797b0c20bc4beeb26b28f614095f7e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:20.301456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:20.301734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:20.302005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:20.452660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] MFA Rules not processed for user `0e702b55ea1442febb8eafe11fb2b598`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:20.454050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.548704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f12e-b250-408b-acd7-2273771ccfc4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:20.662103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 711/1408] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:20.663316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:20.668844 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.776505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:20.779141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:20.779606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:20.780955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:20.792182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.863191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829a883-5aaf-44ed-8a8f-1797d2b0a112 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:20.882414 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:20.883051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:20.883332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:20.883696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:20.884339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:20.886270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:20.901899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:20.953172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 712/1409] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:20 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:20.954325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:20.962305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:20.967942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:20.998978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:21.000719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:21.028146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 698/1410] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:21.029032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:21.033373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.172595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984c666-73fb-4edf-a640-00832811f5a5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:21.187433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:21.188123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.188405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.188714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.198511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.219557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28348-b2dd-4506-bd18-c5a4b4682ba3 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:21.348335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:21.349073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.350514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.350792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.354289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:21.356251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.359034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:21.385580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:21.389260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516efdd-41b9-4eb2-95a4-4f6ee2040ecd service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:21.390328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 713/1411] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:21.391184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:21.424068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 699/1412] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:21.425384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a424-eaf9-4f1f-a0d8-2b25a619cf7c None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.425940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a424-eaf9-4f1f-a0d8-2b25a619cf7c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.425940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a424-eaf9-4f1f-a0d8-2b25a619cf7c None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.433037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 700/1413] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 13:10:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:21.433947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a424-eaf9-4f1f-a0d8-2b25a619cf7c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:21.437303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a989a424-eaf9-4f1f-a0d8-2b25a619cf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.589666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3eec6-f20e-4e3d-9ebe-a79b5394ce6a service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:21.603705 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f07d-06b0-4fe3-b9ad-d54ed33e0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:21.604355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f07d-06b0-4fe3-b9ad-d54ed33e0028 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.604623 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f07d-06b0-4fe3-b9ad-d54ed33e0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.604896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f07d-06b0-4fe3-b9ad-d54ed33e0028 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.605537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5f07d-06b0-4fe3-b9ad-d54ed33e0028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:21.607494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5f07d-06b0-4fe3-b9ad-d54ed33e0028 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:21.608449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a424-eaf9-4f1f-a0d8-2b25a619cf7c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:21.621734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:21.622921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.623391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.623861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] PATH_INFO: `/v3/projects/98c57468adb14820bbf21f35a4885362` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.625515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c57468adb14820bbf21f35a4885362)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:21.628489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:21.631971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:21.657569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 714/1414] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:21 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:21.657569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609460-93d5-499d-b2f6-36e9ff59c772 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.657569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609460-93d5-499d-b2f6-36e9ff59c772 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.657569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609460-93d5-499d-b2f6-36e9ff59c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.695846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c57468adb14820bbf21f35a4885362', 'request_id': 'req-202de4c5-6bb4-4103-a84d-c010916726ef'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:21.700851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-fd609460-93d5-499d-b2f6-36e9ff59c772 None None] MFA Rules not processed for user `0fd9d9e53d0f4a2ca149de05ff08d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:21.702902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fd609460-93d5-499d-b2f6-36e9ff59c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.704632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c57468adb14820bbf21f35a4885362', 'request_id': 'req-202de4c5-6bb4-4103-a84d-c010916726ef'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:21.731918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c57468adb14820bbf21f35a4885362', 'request_id': 'req-202de4c5-6bb4-4103-a84d-c010916726ef'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:21.760169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:21.770976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] The token cache is being invalidate because project 98c57468adb14820bbf21f35a4885362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:21.771292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:21.773652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:21.785492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 701/1415] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:21 2022] DELETE /identity/v3/projects/98c57468adb14820bbf21f35a4885362 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:21.786922 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:21.788552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.898874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 715/1416] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:21.911618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.912009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.912330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.962902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:21.964214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:21.986610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de4c5-6bb4-4103-a84d-c010916726ef admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:21.994753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad91ae-fe20-433d-9c86-28f3154f1a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:21.995793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad91ae-fe20-433d-9c86-28f3154f1a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:21.996276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad91ae-fe20-433d-9c86-28f3154f1a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:21.996744 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad91ae-fe20-433d-9c86-28f3154f1a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:21.998554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad91ae-fe20-433d-9c86-28f3154f1a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.000774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad91ae-fe20-433d-9c86-28f3154f1a33 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.022086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 702/1417] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:22.025553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87186-027a-4fd6-97aa-7bc75e76cd70 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.026006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87186-027a-4fd6-97aa-7bc75e76cd70 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.026474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87186-027a-4fd6-97aa-7bc75e76cd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.074735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 716/1418] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:22.076086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.077668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:22.086552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-8da87186-027a-4fd6-97aa-7bc75e76cd70 None None] MFA Rules not processed for user `506adca00a91411e83a369c937538ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:22.090449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8da87186-027a-4fd6-97aa-7bc75e76cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:22.103878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942310fd-9d60-4f41-b5e3-949205d86b9b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:22.108747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:22.109415 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.109692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.109958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.125801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.127704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.145792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 717/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:22.146991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.171931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e331da-2dc0-4a6b-beef-b6f5672e826b service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:22.189460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:22.190584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.191145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.191928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] PATH_INFO: `/v3/projects/c5c1d8bc35294e27a58eca1e2243feec/users/4637eba8e41246e59f6b02602b8ed8a9/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.206732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 703/1420] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:22.212221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.212758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.213171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.215341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c1d8bc35294e27a58eca1e2243feec, user_id=4637eba8e41246e59f6b02602b8ed8a9, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.219756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.255357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 718/1421] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:22 2022] PUT /identity/v3/projects/c5c1d8bc35294e27a58eca1e2243feec/users/4637eba8e41246e59f6b02602b8ed8a9/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:22.260034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.261566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:22.262866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:22.267528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:22.348324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:22.475417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 704/1422] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:22.484196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.503283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884c49-ce45-4c9b-b9d5-3075af1bfc90 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:22.512116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cf4d7-ed91-42da-952c-7791086be262 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:22.514816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:22.515501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.515784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.516060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] PATH_INFO: `/v3/projects/ca544d3a6fce409b8a32a31dd9b937fb` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.517582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca544d3a6fce409b8a32a31dd9b937fb)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.520590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.528519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:22.529151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.529503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.529933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.530603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.532529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.551695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 705/1423] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:22.561244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.574873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30104ef-c822-45e8-b58d-5776cb2e41ec admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:22.589108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:22.591784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.592878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.593911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.597494 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:22.598614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.604410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.638957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 706/1424] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:22.640074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.643618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:22.653609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca544d3a6fce409b8a32a31dd9b937fb', 'request_id': 'req-c144a935-7a00-4094-85bc-8ff4de80d29a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:22.658118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb959f-b914-476c-912f-0746a215239a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:22.670122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca544d3a6fce409b8a32a31dd9b937fb', 'request_id': 'req-c144a935-7a00-4094-85bc-8ff4de80d29a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:22.688214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca544d3a6fce409b8a32a31dd9b937fb', 'request_id': 'req-c144a935-7a00-4094-85bc-8ff4de80d29a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:22.729531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] The token cache is being invalidate because project ca544d3a6fce409b8a32a31dd9b937fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:22.730145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:22.731220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:22.738439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 719/1425] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:22 2022] DELETE /identity/v3/projects/ca544d3a6fce409b8a32a31dd9b937fb => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:22.738439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.739871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:22.802692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:22.803435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:22.803746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:22.804023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] PATH_INFO: `/v3/projects/c5c1d8bc35294e27a58eca1e2243feec/users/4637eba8e41246e59f6b02602b8ed8a9/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:22.809334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c1d8bc35294e27a58eca1e2243feec, user_id=4637eba8e41246e59f6b02602b8ed8a9, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:22.817107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:22.855988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 707/1426] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:22 2022] PUT /identity/v3/projects/c5c1d8bc35294e27a58eca1e2243feec/users/4637eba8e41246e59f6b02602b8ed8a9/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:22.857556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:22.860044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:22.890769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a935-7a00-4094-85bc-8ff4de80d29a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.021658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb3475-2428-40e3-9ed7-2a02bae670b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.022987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb3475-2428-40e3-9ed7-2a02bae670b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.023360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb3475-2428-40e3-9ed7-2a02bae670b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.023971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb3475-2428-40e3-9ed7-2a02bae670b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.024437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb3475-2428-40e3-9ed7-2a02bae670b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.026668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb3475-2428-40e3-9ed7-2a02bae670b1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:23.052759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832001fd-31bc-4b40-9b19-caaeea4e7b5c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.063492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 720/1427] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:22 2022] POST /identity/v3/projects => generated 389 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:23.063492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.063492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.063492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.068421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.069751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.072952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.073438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] PATH_INFO: `/v3/users/ff0365cb253c409ea4c0abb0ac72cc1f` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.076242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0365cb253c409ea4c0abb0ac72cc1f)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.081960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:23.100867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] MFA Rules not processed for user `4637eba8e41246e59f6b02602b8ed8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:23.103320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:23.183459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:23.188240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:23.199501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0365cb253c409ea4c0abb0ac72cc1f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:23.214587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0365cb253c409ea4c0abb0ac72cc1f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:23.246686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0365cb253c409ea4c0abb0ac72cc1f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:23.249710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0365cb253c409ea4c0abb0ac72cc1f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:23.271503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 721/1428] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:23.271503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:23.276238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0365cb253c409ea4c0abb0ac72cc1f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:23.285731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 708/1429] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:22 2022] DELETE /identity/v3/users/ff0365cb253c409ea4c0abb0ac72cc1f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:23.286633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:23.292691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:23.487958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829623-f40d-42f9-b263-7294c3630314 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.500721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061f5fb-acfc-457f-baf8-9ba5230c95f3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.519240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.520490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.520490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.520762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.533882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:23.573593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.574431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.574810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.575292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.576058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.579502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:23.622160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 722/1430] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:23 2022] POST /identity/v3/users => generated 295 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:23.623164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:23.625441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:23.646350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd2424-c317-4b8a-831c-bc2d7906b51f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.653082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.653712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.653989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.654262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.656288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.660688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:23.676789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 723/1431] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:23.677868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:23.696063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed788c6-4c4e-420a-b793-b49bd4930c5f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.703234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.704390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.704390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.704535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.705110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.708392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:23.762500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 724/1432] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:23.764381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:23.804553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.810895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432716b-0c0a-4044-b11b-ea8bc1f2cca9 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:23.811247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0b1c-e4a5-4b25-bb9e-888ba00a24f8 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:23.837087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:23.837087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:23.837344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:23.837538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] PATH_INFO: `/v3/projects/88ddc341511b4be3b54d5262322f837e/users/8daf3abc1aa2406984f69317bbdda89d/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:23.855747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 709/1433] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:23.946505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ddc341511b4be3b54d5262322f837e, user_id=8daf3abc1aa2406984f69317bbdda89d, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:23.955926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:24.023104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 725/1434] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:23 2022] PUT /identity/v3/projects/88ddc341511b4be3b54d5262322f837e/users/8daf3abc1aa2406984f69317bbdda89d/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:24.039269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:24.043383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:24.043383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:24.119769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] MFA Rules not processed for user `8daf3abc1aa2406984f69317bbdda89d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:24.125589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:24.190203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:24.344347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:24.393809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c48820-6446-42c7-b57e-08a744a609d9 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:24.403689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:24.409418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:24.413568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:24.413568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:24.413568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:24.414500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 710/1435] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:24.417400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:24.428442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:24.673278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52179738-ac2c-4e7c-bd52-28fb40665dd7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:24.677455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:24.680097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f4e1f-818a-4c7f-9939-839e1aea92a2 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:24.687074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:24.688383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:24.688875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:24.689342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:24.690813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:24.693526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:24.715477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 726/1436] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:24.715477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:24.715477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:24.715477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:24.796929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 711/1437] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:24 2022] POST /identity/v3/projects => generated 385 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:24.797608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] MFA Rules not processed for user `6f9396941e5548aebdd1cd5fb4dc9fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:24.804505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:24.805457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:24.820154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:25.000467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 727/1438] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:25.000467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:25.049150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930b2d-8fcb-409a-a258-3366335e5265 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:25.071764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:25.072693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.073092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.073518 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] PATH_INFO: `/v3/projects/9548939f75fc4a1da3b34275b4e25f45` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.077235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9548939f75fc4a1da3b34275b4e25f45)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:25.085170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f66a58-aa0d-4efb-9219-0c7d4350b081 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:25.094436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:25.104609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:25.120913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.123627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.123917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.127220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:25.163688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:25.252102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 728/1439] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:24 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:25.256165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:25.258414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9548939f75fc4a1da3b34275b4e25f45', 'request_id': 'req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:25.290996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7751e1-6a83-4990-a214-2a3948e6954a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:25.295225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9548939f75fc4a1da3b34275b4e25f45', 'request_id': 'req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:25.316948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9548939f75fc4a1da3b34275b4e25f45', 'request_id': 'req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:25.349418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] The token cache is being invalidate because project 9548939f75fc4a1da3b34275b4e25f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:25.350548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:25.360597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a7c2674b-5dc6-446a-b6ea-b2e5fc8c85dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:25.363832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 712/1440] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:24 2022] DELETE /identity/v3/projects/9548939f75fc4a1da3b34275b4e25f45 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:25.369498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdb7ff-063b-424b-8bba-e821e2fa1a8f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.370023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdb7ff-063b-424b-8bba-e821e2fa1a8f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.370493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdb7ff-063b-424b-8bba-e821e2fa1a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.449242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6ccdb7ff-063b-424b-8bba-e821e2fa1a8f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:25.463202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6ccdb7ff-063b-424b-8bba-e821e2fa1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:25.506240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:25.531724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:25.534417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.538507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.539090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.541767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:25.549208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:25.595146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 729/1441] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:25.598866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:25.613296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:25.663866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2355-b5af-4755-ab02-484f1338ec68 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:25.683100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 713/1442] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:25.691881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:25.694394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.694910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.695334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.695809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] PATH_INFO: `/v3/projects/fc1d223f60704527a37f0b07f3e43351/users/0e673c45456a4ef7bd9c8205633c3731/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.700782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.701153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.770162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1d223f60704527a37f0b07f3e43351, user_id=0e673c45456a4ef7bd9c8205633c3731, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:25.776592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:25.781908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:25.786205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:25.789707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:25.815583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 714/1443] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:25.817802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:25.834162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 730/1444] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:25 2022] PUT /identity/v3/projects/fc1d223f60704527a37f0b07f3e43351/users/0e673c45456a4ef7bd9c8205633c3731/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:25.838199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454781-1e49-4c51-a49a-17b962c44845 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:25.838880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:25.985914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:25.986548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:25.986824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:25.987094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:25.993628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:25.993960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:25.995660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:26.021171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 715/1445] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:10:26.022340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:26.054883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783f228-0311-4015-9d36-1231c034f46f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:26.074184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:26.076414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.076929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.077207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.077864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:26.090157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:26.109491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60969278-df97-40bd-97ca-1ecc9b4f4d77 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:26.131809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:26.134726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.135007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.136427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.137764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:26.143303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:26.169398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 731/1446] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:26.173519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:26.194327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a3411-843d-435c-a527-17826fc9aac0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:26.212087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68479daa-c52c-473a-a23d-cf46aadd3fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:26.214949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68479daa-c52c-473a-a23d-cf46aadd3fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.215251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68479daa-c52c-473a-a23d-cf46aadd3fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.217017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68479daa-c52c-473a-a23d-cf46aadd3fe8 admin admin] PATH_INFO: `/v3/projects/fc1d223f60704527a37f0b07f3e43351/users/0e673c45456a4ef7bd9c8205633c3731/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.223301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 716/1447] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:26 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:26.226182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:26.226618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68479daa-c52c-473a-a23d-cf46aadd3fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1d223f60704527a37f0b07f3e43351, user_id=0e673c45456a4ef7bd9c8205633c3731, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:26.231824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68479daa-c52c-473a-a23d-cf46aadd3fe8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:26.299694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 732/1448] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:26 2022] PUT /identity/v3/projects/fc1d223f60704527a37f0b07f3e43351/users/0e673c45456a4ef7bd9c8205633c3731/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:26.299694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568a34a-6233-4a6b-bb3c-001eaf0990d7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.299694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568a34a-6233-4a6b-bb3c-001eaf0990d7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.299694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568a34a-6233-4a6b-bb3c-001eaf0990d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.360270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e568a34a-6233-4a6b-bb3c-001eaf0990d7 None None] MFA Rules not processed for user `0e673c45456a4ef7bd9c8205633c3731`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:26.362467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e568a34a-6233-4a6b-bb3c-001eaf0990d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:26.542169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1882-6463-4b09-9443-8c54f46e2aa9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:26.587350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 733/1449] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:26.592183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.593826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.594655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.614377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:26.676812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:26.677836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.679147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.679631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.680446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:26.683600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:26.696949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:26.698655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:26.755765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 717/1450] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:26 2022] POST /identity/v3/users => generated 292 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:26.758633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:26.763156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:26.820379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:26.875729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 734/1451] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:26.876809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:26.895632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf88f0-7b37-4c5a-ae12-daaf62c37c95 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:26.908064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:26.911925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:26.913141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:26.913475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:26.927578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:26.946364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:27.000836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 735/1452] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:27.004900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:27.007272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3521257-984d-41d5-ad00-0d3cfe3ae9f0 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:27.033112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:27.033865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:27.034250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:27.034623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:27.041165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c425-85dc-43b6-9d31-9f0aefe9cf9c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:27.060657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:27.063839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:27.091003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:27.092045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:27.092406 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:27.092685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:27.093384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:27.110737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 718/1453] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:27.114202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:27.187495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 736/1454] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:27.191716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:27.207688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bdb30-6742-44c3-ba7a-53b4639e4869 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:27.232301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a820a4-e30c-494f-8afb-2f68f3c21dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:27.233389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a820a4-e30c-494f-8afb-2f68f3c21dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:27.233866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a820a4-e30c-494f-8afb-2f68f3c21dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:27.234968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a820a4-e30c-494f-8afb-2f68f3c21dd2 admin admin] PATH_INFO: `/v3/projects/dd0cc4fd8b1f46cebdf6dc21b10d7649/users/c06ce3b7f3bd40928b1d36d5c315caa7/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:27.258617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:27.260740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:27.294606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a820a4-e30c-494f-8afb-2f68f3c21dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0cc4fd8b1f46cebdf6dc21b10d7649, user_id=c06ce3b7f3bd40928b1d36d5c315caa7, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:27.300603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a820a4-e30c-494f-8afb-2f68f3c21dd2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:27.357200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 719/1455] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:27 2022] PUT /identity/v3/projects/dd0cc4fd8b1f46cebdf6dc21b10d7649/users/c06ce3b7f3bd40928b1d36d5c315caa7/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:27.363732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:27.366245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:27.367663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:27.435907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] MFA Rules not processed for user `c06ce3b7f3bd40928b1d36d5c315caa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:27.444940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:27.601502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 720/1456] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:27.603207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:27.644771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:27.673261 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c64e7-7bfc-4a72-a73b-beae6a6ea5e4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:27.697662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1ecc-c851-4eec-9ebe-0cd87a3e5bfd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:27.747630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:27.747630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:27.747630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:27.747630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] PATH_INFO: `/v3/users/8daf3abc1aa2406984f69317bbdda89d` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:27.747947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8daf3abc1aa2406984f69317bbdda89d)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:27.754926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:27.957434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2996d5-a033-40bd-a7d8-c0bb46d2d526 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:27.958068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2996d5-a033-40bd-a7d8-c0bb46d2d526 service swift] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:27.958331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2996d5-a033-40bd-a7d8-c0bb46d2d526 service swift] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:27.958598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2996d5-a033-40bd-a7d8-c0bb46d2d526 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:27.990076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8daf3abc1aa2406984f69317bbdda89d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:28.058149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8daf3abc1aa2406984f69317bbdda89d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:28.105723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8daf3abc1aa2406984f69317bbdda89d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:28.108111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8daf3abc1aa2406984f69317bbdda89d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:28.135396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8daf3abc1aa2406984f69317bbdda89d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:28.144169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 721/1457] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:27 2022] DELETE /identity/v3/users/8daf3abc1aa2406984f69317bbdda89d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:28.150542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:28.152580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:28.153595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:28.235711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2996d5-a033-40bd-a7d8-c0bb46d2d526 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:28.242124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2996d5-a033-40bd-a7d8-c0bb46d2d526 service swift] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:28.272982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 737/1458] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:10:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1015 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 13:10:28.274535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:28.274801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:28.275137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:28.331554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:28.331554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:28.513466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cd99c-2474-4f6f-87d5-2b7c9ce07be7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:28.531674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:28.533934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:28.535631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:28.538978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:28.540168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:28.543344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:28.645529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 738/1459] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:28.654469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 722/1460] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:28 2022] POST /identity/v3/projects => generated 381 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:28.659391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:28.694752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea0a3-e002-4406-a517-63270d0c2ab4 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:28.698397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:28.700405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:28.877016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:28.988294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69771e1-1d16-4662-99db-a8d428667a66 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:29.003984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:29.005524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.007563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.007910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.032067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:29.035341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.035956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.039625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.044362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:29.048881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:29.051531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:29.052844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:29.096956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 723/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:29.125234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 739/1462] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:28 2022] POST /identity/v3/users => generated 297 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:29.125724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:29.141782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e32a16-acf9-4f27-b5c8-d2a9c84feebb service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:29.156984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:29.158114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.160415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.160875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.163899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:29.166855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:29.204314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 724/1463] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:29.225243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:29.295127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9464-cbeb-4477-a4e8-f021b609181c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:29.313232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:29.314435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.315007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.315704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] PATH_INFO: `/v3/projects/79fe0bab6bf24376b3e87e730d8f289e/users/b537a3738d6d47beab199cd7cc00c7d3/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.361476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fe0bab6bf24376b3e87e730d8f289e, user_id=b537a3738d6d47beab199cd7cc00c7d3, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:29.366332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:29.405472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 740/1464] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:29 2022] PUT /identity/v3/projects/79fe0bab6bf24376b3e87e730d8f289e/users/b537a3738d6d47beab199cd7cc00c7d3/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:29.406000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:29.432109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c90b-76b6-4212-80c3-9e0601557d8f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:29.637951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2651-90e5-4e92-8713-98e5a57dcda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:29.638640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2651-90e5-4e92-8713-98e5a57dcda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.639202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2651-90e5-4e92-8713-98e5a57dcda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.639673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2651-90e5-4e92-8713-98e5a57dcda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.640876 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2651-90e5-4e92-8713-98e5a57dcda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:29.642664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2651-90e5-4e92-8713-98e5a57dcda0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:29.674609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 725/1465] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:29.680533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:29.697588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b679d-93c9-43b5-8c2c-b802f394618c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:29.723596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:29.726652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.728253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.730667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] PATH_INFO: `/v3/projects/79fe0bab6bf24376b3e87e730d8f289e/users/b537a3738d6d47beab199cd7cc00c7d3/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.738528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fe0bab6bf24376b3e87e730d8f289e, user_id=b537a3738d6d47beab199cd7cc00c7d3, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:29.751818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:29.789029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 741/1466] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:29 2022] PUT /identity/v3/projects/79fe0bab6bf24376b3e87e730d8f289e/users/b537a3738d6d47beab199cd7cc00c7d3/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:29.802819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d316f-2c6c-46dc-b8f7-b9e64bfca197 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:29.803390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d316f-2c6c-46dc-b8f7-b9e64bfca197 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:29.804809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d316f-2c6c-46dc-b8f7-b9e64bfca197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:29.875713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c40d316f-2c6c-46dc-b8f7-b9e64bfca197 None None] MFA Rules not processed for user `b537a3738d6d47beab199cd7cc00c7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:29.880990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c40d316f-2c6c-46dc-b8f7-b9e64bfca197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:30.228411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 726/1467] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:30.243046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:30.245804 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:30.352429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:30.470141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcae4f-cd0d-4c49-82eb-b82e46f03f6e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:30.489337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:30.490286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:30.490675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:30.491846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:30.507732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:30.510435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:30.561851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 742/1468] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:30.778153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdcf12-5374-46a9-b412-e041a184aee5 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:30.778580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdcf12-5374-46a9-b412-e041a184aee5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:30.778723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdcf12-5374-46a9-b412-e041a184aee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:30.834262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d8bdcf12-5374-46a9-b412-e041a184aee5 None None] MFA Rules not processed for user `cdcf94479e2f4ca7bdf455dbab82e336`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:30.836192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d8bdcf12-5374-46a9-b412-e041a184aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:30.844166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:30.854052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f16c3-8d4f-4a36-b505-cb4f4f873348 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:30.872955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:30.873568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:30.873924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:30.874120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:30.883941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:31.018550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:31.088247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 727/1469] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:31.170706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:31.179253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:31.246405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 743/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:31.706926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:31.707462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:31.707462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:31.733742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:31.733742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:31.780544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] MFA Rules not processed for user `0fd9d9e53d0f4a2ca149de05ff08d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:31.781988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:32.010560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa45b9-c310-4245-aa17-f9cb99e5af10 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:32.018003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 728/1471] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Oct 13 13:10:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:32.023278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:32.024073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:32.024361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:32.024641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] PATH_INFO: `/v3/projects/88ddc341511b4be3b54d5262322f837e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:32.028529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ddc341511b4be3b54d5262322f837e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:32.036589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:32.045708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:32.051508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9199e-ee9c-46b8-9291-adca4b98a4be None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:32.070810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:32.072541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:32.073327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:32.073755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:32.109674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:32.114349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:32.160649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 729/1472] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:32.244338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ddc341511b4be3b54d5262322f837e', 'request_id': 'req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.266855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ddc341511b4be3b54d5262322f837e', 'request_id': 'req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.284059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ddc341511b4be3b54d5262322f837e', 'request_id': 'req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.309692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] The token cache is being invalidate because project 88ddc341511b4be3b54d5262322f837e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:32.311499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.312761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.316034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:32.316869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 744/1473] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:31 2022] DELETE /identity/v3/projects/88ddc341511b4be3b54d5262322f837e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:32.321260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:32.355277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfe567-6adb-4222-afc0-6fb1697be9a9 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:32.525009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:32.529897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:32.530861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:32.535112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] PATH_INFO: `/v3/users/0e673c45456a4ef7bd9c8205633c3731` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:32.537037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e673c45456a4ef7bd9c8205633c3731)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:32.543636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:32.685505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e673c45456a4ef7bd9c8205633c3731'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.746458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e673c45456a4ef7bd9c8205633c3731'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.777732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e673c45456a4ef7bd9c8205633c3731'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.779645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e673c45456a4ef7bd9c8205633c3731'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.799697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-da0a655f-021e-44de-9561-9326814a8790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e673c45456a4ef7bd9c8205633c3731'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:32.856681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 730/1474] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:32 2022] DELETE /identity/v3/users/0e673c45456a4ef7bd9c8205633c3731 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:34.597723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:34.599293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:34.630852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e88b-8bc7-48a1-9d70-bfb5bd1987d0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:34.858498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:34.859166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:34.859470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:34.859768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] PATH_INFO: `/v3/users/0e702b55ea1442febb8eafe11fb2b598` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:34.869194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e702b55ea1442febb8eafe11fb2b598)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:34.871235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:34.984880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e702b55ea1442febb8eafe11fb2b598'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:34.985558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e702b55ea1442febb8eafe11fb2b598'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.019741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e702b55ea1442febb8eafe11fb2b598'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.033522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e702b55ea1442febb8eafe11fb2b598'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.035071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e702b55ea1442febb8eafe11fb2b598'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.070638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 745/1475] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:34 2022] DELETE /identity/v3/users/0e702b55ea1442febb8eafe11fb2b598 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:35.076481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:35.076998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:35.077315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:35.099216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:35.212777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:35.221630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:35.223211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:35.229123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:35.443387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3212f-13cd-4456-9c28-a732c0681765 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:35.456008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 731/1476] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:35.459303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:35.460557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:35.461085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:35.461572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] PATH_INFO: `/v3/users/c06ce3b7f3bd40928b1d36d5c315caa7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:35.463021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06ce3b7f3bd40928b1d36d5c315caa7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:35.465490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:35.493484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:35.495305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:35.568826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:35.641908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06ce3b7f3bd40928b1d36d5c315caa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.645548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06ce3b7f3bd40928b1d36d5c315caa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.679467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06ce3b7f3bd40928b1d36d5c315caa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.681536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715e4e-420a-43be-82de-75d8e9ba5246 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:35.689850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:35.691493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:35.692233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:35.693159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:35.695645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06ce3b7f3bd40928b1d36d5c315caa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.697331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cd723880-c527-4caf-883e-820aa50075f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06ce3b7f3bd40928b1d36d5c315caa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:35.700618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:35.730381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 746/1477] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:35 2022] DELETE /identity/v3/users/c06ce3b7f3bd40928b1d36d5c315caa7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:35.737025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42051b-3909-4a30-8af8-2c435a93ef9f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:35.737821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:35.738692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42051b-3909-4a30-8af8-2c435a93ef9f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:35.740010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:35.740280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42051b-3909-4a30-8af8-2c435a93ef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:35.779591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 732/1478] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:35.796176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-cb42051b-3909-4a30-8af8-2c435a93ef9f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:35.797813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-cb42051b-3909-4a30-8af8-2c435a93ef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:35.926945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 747/1479] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:36.074799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:36.076834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:36.110691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac81e-c20a-4878-acb2-9fe4c2e07235 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:36.298924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c1b6f-7331-4569-b79c-2e898b5aa35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:36.302563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c1b6f-7331-4569-b79c-2e898b5aa35a service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:36.304308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c1b6f-7331-4569-b79c-2e898b5aa35a service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:36.307223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c1b6f-7331-4569-b79c-2e898b5aa35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:36.333855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c1b6f-7331-4569-b79c-2e898b5aa35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:36.338380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c1b6f-7331-4569-b79c-2e898b5aa35a service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:36.380802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 733/1480] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:36.486327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa417023-c969-46b9-986e-03c609faad49 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:36.486614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa417023-c969-46b9-986e-03c609faad49 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:36.487353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa417023-c969-46b9-986e-03c609faad49 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:36.489868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 748/1481] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:36.809341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:36.809732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:36.810144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:36.856107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:36.857434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:36.986018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:37.023700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 734/1482] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:37.138558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa417023-c969-46b9-986e-03c609faad49 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:37.142541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-aa417023-c969-46b9-986e-03c609faad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:37.185927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa417023-c969-46b9-986e-03c609faad49 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:37.197475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:37.198254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:37.198952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:37.205983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] PATH_INFO: `/v3/projects/fc1d223f60704527a37f0b07f3e43351` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:37.208154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1d223f60704527a37f0b07f3e43351)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:37.217278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:37.334222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1d223f60704527a37f0b07f3e43351', 'request_id': 'req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:37.344850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:37.347671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1d223f60704527a37f0b07f3e43351', 'request_id': 'req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:37.347960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:37.366743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1d223f60704527a37f0b07f3e43351', 'request_id': 'req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:37.410391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aafc89-503b-4488-9c94-c50d49cc6c3c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:37.414430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] The token cache is being invalidate because project fc1d223f60704527a37f0b07f3e43351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:37.414733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:37.418129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-aaf9dc35-d1c5-44fa-9ab9-3ae3301696aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:37.425516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 749/1483] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:37 2022] DELETE /identity/v3/projects/fc1d223f60704527a37f0b07f3e43351 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:37.444051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:37.444898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:37.445183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:37.567746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:37.577537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:37.639842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33449caa-4654-4da0-857d-43732d558567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:37.642350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449caa-4654-4da0-857d-43732d558567 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:37.642735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449caa-4654-4da0-857d-43732d558567 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:37.643300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449caa-4654-4da0-857d-43732d558567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:37.649752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-33449caa-4654-4da0-857d-43732d558567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:37.676010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:37.698584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33449caa-4654-4da0-857d-43732d558567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:37.700046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33449caa-4654-4da0-857d-43732d558567 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:37.766226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 735/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:37.849521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:37.849801 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:37.850075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:37.864781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 750/1485] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:37.926249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:37.926881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:38.005234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:38.017356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 736/1486] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:38.021181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd68e-c6a8-4ee8-b6e5-2f15fa36b105 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:38.035032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:38.036139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.036645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.037202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.038384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:38.038838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:38.041038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:38.074794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:38.079813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 751/1487] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:10:38.088219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a9326-1944-40a0-8a9d-2cf6f696aad0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:38.109452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:38.112278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.112795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.112924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.113539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:38.120451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:38.259503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 737/1488] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:38 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:38.261110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:38.276217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e609c5a-8697-430a-8bfe-5f2b87d0999f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:38.465086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:38.465827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.466117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.466463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.467189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:38.472785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:38.536231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 752/1489] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:38 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:38.538704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:38.563578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f49d2-0d73-4ead-aab3-c2e28e2ac7d7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:38.575347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:38.576364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.576794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.577225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.579519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:38.582134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:38.597995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 738/1490] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:38.603137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:38.619591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248cd66-f33f-4234-b8c8-9a6260267852 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:38.628003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717e328-18ae-4ac1-8e00-9a3816fe7eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:38.629088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717e328-18ae-4ac1-8e00-9a3816fe7eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.629568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717e328-18ae-4ac1-8e00-9a3816fe7eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.630111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717e328-18ae-4ac1-8e00-9a3816fe7eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.631611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717e328-18ae-4ac1-8e00-9a3816fe7eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:38.634292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717e328-18ae-4ac1-8e00-9a3816fe7eb5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:38.658628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 753/1491] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:38.664146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:38.685183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c672d7-cbb8-4ec2-991b-fe8b4aac657a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:38.693049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:38.694596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.695146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.695600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] PATH_INFO: `/v3/projects/763cfc5568694f3ca6018c3480081dd6/users/20e5373f56dc41629442314a852d2b8a/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.748318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763cfc5568694f3ca6018c3480081dd6, user_id=20e5373f56dc41629442314a852d2b8a, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:38.752014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:38.778348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 739/1492] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:38 2022] PUT /identity/v3/projects/763cfc5568694f3ca6018c3480081dd6/users/20e5373f56dc41629442314a852d2b8a/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:38.789949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:38.790239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:38.790519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:38.885245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] MFA Rules not processed for user `20e5373f56dc41629442314a852d2b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:38.887252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:39.007591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:39.010744 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:39.086416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 754/1493] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:39.088838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:39.139232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:39.242828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59f8c9-1393-4157-a371-f8bfe128ee69 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:39.257713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:39.258483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:39.258954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:39.259344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] PATH_INFO: `/v3/projects/d78dbb9576ae4035bd4a5f9ed09f967f` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:39.266752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782adfe-8c1a-4752-9696-93bf1feceff4 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:39.268450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78dbb9576ae4035bd4a5f9ed09f967f)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:39.276627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:39.287027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:39.287812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:39.288698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:39.289131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:39.290041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:39.302773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:39.308526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:39.414651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 755/1494] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:39 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:39.419780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:39.498096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78dbb9576ae4035bd4a5f9ed09f967f', 'request_id': 'req-36d77d5e-d9fc-4330-aeac-e772818d1337'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:39.531528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78dbb9576ae4035bd4a5f9ed09f967f', 'request_id': 'req-36d77d5e-d9fc-4330-aeac-e772818d1337'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:39.550982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78dbb9576ae4035bd4a5f9ed09f967f', 'request_id': 'req-36d77d5e-d9fc-4330-aeac-e772818d1337'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:39.598230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] The token cache is being invalidate because project d78dbb9576ae4035bd4a5f9ed09f967f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:39.598524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:39.608177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:39.622532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 740/1495] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:39 2022] DELETE /identity/v3/projects/d78dbb9576ae4035bd4a5f9ed09f967f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:39.623789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:39.628571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:39.649570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478106-8aee-4518-b5d8-44ebb2f02e66 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:39.817827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:39.818455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:39.818786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:39.819362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:39.820475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:39.824429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:39.841704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77d5e-d9fc-4330-aeac-e772818d1337 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:39.852699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:39.853619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:39.853899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:39.854174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] PATH_INFO: `/v3/users/4637eba8e41246e59f6b02602b8ed8a9` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:39.859990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 756/1496] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:39 2022] POST /identity/v3/users => generated 299 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:39.860317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4637eba8e41246e59f6b02602b8ed8a9)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:39.862298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:39.870969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:39.875837 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:39.924729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f1db6-056b-4712-8393-178905d5c87b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:39.943487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:39.944200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:39.944517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:39.944795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:39.945452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:39.947147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:39.978064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 757/1497] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:39.979349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:40.001221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1a18-462f-4eb8-8fc2-d1e310c4bb37 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:40.025792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:40.027700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:40.028732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:40.030801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] PATH_INFO: `/v3/projects/b594ae23551c4483b5eb8bac447ef805/users/4949bda31f4f48e8ab2eb75b92e3e193/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:40.038772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4637eba8e41246e59f6b02602b8ed8a9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:40.077577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4637eba8e41246e59f6b02602b8ed8a9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:40.087860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b594ae23551c4483b5eb8bac447ef805, user_id=4949bda31f4f48e8ab2eb75b92e3e193, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:40.095196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:40.110953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4637eba8e41246e59f6b02602b8ed8a9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:40.112372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4637eba8e41246e59f6b02602b8ed8a9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:40.122569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 758/1498] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:39 2022] PUT /identity/v3/projects/b594ae23551c4483b5eb8bac447ef805/users/4949bda31f4f48e8ab2eb75b92e3e193/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:40.127031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4637eba8e41246e59f6b02602b8ed8a9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:40.130450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:40.132946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:40.143577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:40.149060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 741/1499] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:39 2022] DELETE /identity/v3/users/4637eba8e41246e59f6b02602b8ed8a9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:40.317992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea5a9-bdf2-45d0-8647-31bcbcfa34c1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:40.461883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2fdb-68e8-46db-be13-b7c242a874a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:40.462534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2fdb-68e8-46db-be13-b7c242a874a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:40.462817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2fdb-68e8-46db-be13-b7c242a874a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:40.463164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2fdb-68e8-46db-be13-b7c242a874a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:40.466125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2fdb-68e8-46db-be13-b7c242a874a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:40.467851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2fdb-68e8-46db-be13-b7c242a874a7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:40.503203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 759/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:40.506921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:40.521154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0f821-e6eb-42fa-9cbc-f394cf0139e3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:40.541103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:40.541796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:40.542082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:40.542405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] PATH_INFO: `/v3/projects/b594ae23551c4483b5eb8bac447ef805/users/4949bda31f4f48e8ab2eb75b92e3e193/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:40.544839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b594ae23551c4483b5eb8bac447ef805, user_id=4949bda31f4f48e8ab2eb75b92e3e193, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:40.549888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:40.568524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:40.578780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 742/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:40 2022] PUT /identity/v3/projects/b594ae23551c4483b5eb8bac447ef805/users/4949bda31f4f48e8ab2eb75b92e3e193/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:40.591609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:40.592230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:40.592714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:40.681866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] MFA Rules not processed for user `4949bda31f4f48e8ab2eb75b92e3e193`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:40.683117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:40.852170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 760/1502] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:40.867025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:40.868888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:41.021590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887268b8-23ff-4bc9-9813-e4de064d3219 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:41.028645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:41.029902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:41.030186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:41.030460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:41.033602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:41.291380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:41.293136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68656cee-bdb8-40fa-9b5b-f85eff7ce968 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:41.324388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 743/1503] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:42.279611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:42.279611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:42.296333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7af7a-4921-43d6-8bb8-96b318a4591e None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.297244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7af7a-4921-43d6-8bb8-96b318a4591e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.297712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7af7a-4921-43d6-8bb8-96b318a4591e None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.299939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 744/1504] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:10:42.337338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:42.346830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.347115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.347656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.373803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:42.375895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:42.427271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b491b1-22f5-4056-92ff-256d1121e8a1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:42.433881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:42.435335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.435813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.436240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] PATH_INFO: `/v3/projects/dd0cc4fd8b1f46cebdf6dc21b10d7649` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.437841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0cc4fd8b1f46cebdf6dc21b10d7649)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:42.439967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:42.502441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0cc4fd8b1f46cebdf6dc21b10d7649', 'request_id': 'req-3208ff73-5111-4189-9d2f-56af099ad375'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.503726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 745/1505] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:42.510136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0cc4fd8b1f46cebdf6dc21b10d7649', 'request_id': 'req-3208ff73-5111-4189-9d2f-56af099ad375'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.519864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0cc4fd8b1f46cebdf6dc21b10d7649', 'request_id': 'req-3208ff73-5111-4189-9d2f-56af099ad375'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.534984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] The token cache is being invalidate because project dd0cc4fd8b1f46cebdf6dc21b10d7649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:42.535283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.536161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.541457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 761/1506] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:42 2022] DELETE /identity/v3/projects/dd0cc4fd8b1f46cebdf6dc21b10d7649 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:42.542822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:42.564733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:42.567179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9bcbb-43b6-43bb-90b0-65e660d19861 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:42.568994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:42.667620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:42.692588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:42.693629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.694164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.695392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] PATH_INFO: `/v3/users/b537a3738d6d47beab199cd7cc00c7d3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.697739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b537a3738d6d47beab199cd7cc00c7d3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:42.701500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:42.705339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208ff73-5111-4189-9d2f-56af099ad375 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:42.717958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:42.718601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.718879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.719148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.721557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:42.743166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:42.745436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:42.763601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 762/1507] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:42.765551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:42.771269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:42.772020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b537a3738d6d47beab199cd7cc00c7d3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.782188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b537a3738d6d47beab199cd7cc00c7d3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.803459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b537a3738d6d47beab199cd7cc00c7d3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.805480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b537a3738d6d47beab199cd7cc00c7d3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.827016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639af13-3740-4856-aa88-955250cf1668 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:42.829490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ad276312-86a0-4586-a95d-0ca86ea839e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b537a3738d6d47beab199cd7cc00c7d3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.841301 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:42.841956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.842240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.846882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 746/1508] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:42 2022] DELETE /identity/v3/users/b537a3738d6d47beab199cd7cc00c7d3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:42.850440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] PATH_INFO: `/v3/projects/c5c1d8bc35294e27a58eca1e2243feec` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.855286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c1d8bc35294e27a58eca1e2243feec)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:42.858603 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:42.929691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:42.933888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c1d8bc35294e27a58eca1e2243feec', 'request_id': 'req-5589c639-90e9-43db-a65c-392aacfc23d2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.943517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c1d8bc35294e27a58eca1e2243feec', 'request_id': 'req-5589c639-90e9-43db-a65c-392aacfc23d2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.952492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c1d8bc35294e27a58eca1e2243feec', 'request_id': 'req-5589c639-90e9-43db-a65c-392aacfc23d2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.965282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] The token cache is being invalidate because project c5c1d8bc35294e27a58eca1e2243feec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:42.966207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.967050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5589c639-90e9-43db-a65c-392aacfc23d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:42.969195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 763/1509] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:42 2022] DELETE /identity/v3/projects/c5c1d8bc35294e27a58eca1e2243feec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:42.974217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:42.974509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:42.974787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:42.997555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:42.998787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.067585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 747/1510] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:43.076924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.077209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.077544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.102861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:43.104666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.112799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 764/1511] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:43.117108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.127319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb94e7-2896-4c5e-bfd3-21616fe6985f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.133103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.134102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.134102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.134305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.134920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:43.135280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.136939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.153793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 748/1512] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:43.155230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.166569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d548-13b6-4bed-8b37-3298f1f0d8bf None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.171916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.172584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.172884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.173200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.173845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.176191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.182370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.184164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.198626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1547796-fa9d-4bb7-9a89-ebda318058fb admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.203671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.204312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.204592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.204863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] PATH_INFO: `/v3/projects/79fe0bab6bf24376b3e87e730d8f289e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.205999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79fe0bab6bf24376b3e87e730d8f289e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.208958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.242739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 765/1513] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:43.246857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.306684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:43.309941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fe0bab6bf24376b3e87e730d8f289e', 'request_id': 'req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:43.329072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fe0bab6bf24376b3e87e730d8f289e', 'request_id': 'req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:43.347067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fe0bab6bf24376b3e87e730d8f289e', 'request_id': 'req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:43.363723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba20ead-6b2e-4e44-80db-91e3d32a3bf4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.367759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] The token cache is being invalidate because project 79fe0bab6bf24376b3e87e730d8f289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:43.368060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:43.369577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8e89d6ac-e2fb-4c41-a109-5f6d2c124ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:43.373444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 749/1514] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:43 2022] DELETE /identity/v3/projects/79fe0bab6bf24376b3e87e730d8f289e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:43.378541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924ea32-85cc-4cac-b065-71f7d097ee66 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.378825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924ea32-85cc-4cac-b065-71f7d097ee66 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.379096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924ea32-85cc-4cac-b065-71f7d097ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.456792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.457607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.457989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.458601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.459318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.462407 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.493920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 766/1515] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:43.498745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.501783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.518448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3e03-810d-47be-8213-2cec880a6734 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.539974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.540716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.541006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.541284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.541949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.543861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.557235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 767/1516] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:43.561115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.579342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518333a0-d542-4b78-9d49-7d06eef8d831 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.586655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.587137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.587440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.587720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.588373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.589983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.602027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 768/1517] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:43.606572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.615577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9924ea32-85cc-4cac-b065-71f7d097ee66 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:43.617932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9924ea32-85cc-4cac-b065-71f7d097ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.622821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13ae7-2289-4cd7-9e3b-82b2097811e3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.629114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055aec-b2e4-433b-b394-90a92d18db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.629271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 750/1518] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:43.630086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055aec-b2e4-433b-b394-90a92d18db1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.630365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055aec-b2e4-433b-b394-90a92d18db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.630640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055aec-b2e4-433b-b394-90a92d18db1e admin admin] PATH_INFO: `/v3/projects/098beda5e7d64dedb83bba37321f3ffe/users/4dddea7104a44108819ad0d7d26ff6ec/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.637775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.638077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.638368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.648546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16055aec-b2e4-433b-b394-90a92d18db1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=098beda5e7d64dedb83bba37321f3ffe, user_id=4dddea7104a44108819ad0d7d26ff6ec, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.651353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16055aec-b2e4-433b-b394-90a92d18db1e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.653658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:43.664879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:43.668663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.674634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 769/1519] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:43 2022] PUT /identity/v3/projects/098beda5e7d64dedb83bba37321f3ffe/users/4dddea7104a44108819ad0d7d26ff6ec/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:43.686337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.686683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.686913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.750828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] MFA Rules not processed for user `4dddea7104a44108819ad0d7d26ff6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:43.753230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:43.796866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 751/1520] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:43.799168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.865547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeda1f-1a62-4333-bfc3-d0fdf2e3bb13 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.888829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.888829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.888829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.888829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.889109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:43.889835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.896549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.930480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 752/1521] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:43.934731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.960340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 770/1522] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:43.961661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc3aae-3834-47e6-9bd6-bc359dd4739b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:43.971073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:43.971866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:43.972554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:43.972797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:43.973073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:43.973717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:43.980807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:43.999359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b28a-934a-452c-83ae-82fdfdc0df6c None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.008599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.009489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.009770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.010101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.010806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.019386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.047524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 753/1523] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:44.048685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.073272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 771/1524] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:43 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:44.077465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.151003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54498-2b61-4ac1-b569-145742860255 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.216630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe4cd5-36d9-4c6d-aca9-0974163c80e6 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.222353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.223035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.223363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.223675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.224495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.227231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.256694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:44.267395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 772/1525] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:44 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:44.271302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.277404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.278233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.278682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.279035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.280113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.282723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.305917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98418c2f-50cb-4b99-8e6f-3dc170f75aff admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.323160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.323958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.324398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.324685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.325353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.327553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.341160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 754/1526] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:44 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:44.345113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.357956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700426-b3ca-42c9-b7f3-6a8ca3d1298b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.362532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.363419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.363709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.363880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 773/1527] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:44.364329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.364609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.364950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.366342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.385942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c63d-6fe0-4862-9dda-384276a6d94a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.388131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 755/1528] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:44.393817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.406593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.407361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.407743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.408817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] PATH_INFO: `/v3/projects/0cb0a6442e1c467caace7db8fa085808/users/080ffac902be4064abd566125db363a4/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.416570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01a778-ceb0-4165-aeb1-dcaf2e2ece44 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.426198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.427221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.427221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.427419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.428120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.430459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.444883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 756/1529] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:44.445060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb0a6442e1c467caace7db8fa085808, user_id=080ffac902be4064abd566125db363a4, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.446436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.448252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.462302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d96160-e825-49c5-8c92-dedeef2ba641 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.474920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 774/1530] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:44 2022] PUT /identity/v3/projects/0cb0a6442e1c467caace7db8fa085808/users/080ffac902be4064abd566125db363a4/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:44.477396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.511257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:44.568137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ee8e0-0134-42b6-ba19-1b5b57ef69cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.569132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ee8e0-0134-42b6-ba19-1b5b57ef69cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.569426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ee8e0-0134-42b6-ba19-1b5b57ef69cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.569751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ee8e0-0134-42b6-ba19-1b5b57ef69cd admin admin] PATH_INFO: `/v3/projects/c6b7f3b72dca4a5bb36c9a8c0206cc6c/users/83e577a92048466ab21d7fbc4a0e0914/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.592539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b229-7149-4df8-aaaa-711fb4f5f0e8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.600651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ee8e0-0134-42b6-ba19-1b5b57ef69cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b7f3b72dca4a5bb36c9a8c0206cc6c, user_id=83e577a92048466ab21d7fbc4a0e0914, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.602376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.603056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.603700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.603958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.604708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.605198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ee8e0-0134-42b6-ba19-1b5b57ef69cd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.607238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.619956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 775/1531] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:44.623616 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.631860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 757/1532] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:44 2022] PUT /identity/v3/projects/c6b7f3b72dca4a5bb36c9a8c0206cc6c/users/83e577a92048466ab21d7fbc4a0e0914/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:44.637602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.637747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5539ac-181a-47e1-9d1b-8c5942c33f8a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.638163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.638736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.675349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] MFA Rules not processed for user `83e577a92048466ab21d7fbc4a0e0914`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:44.677589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:44.735213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b0ce1-0b25-42c1-8553-15024e9ba6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.736100 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0ce1-0b25-42c1-8553-15024e9ba6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.736214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0ce1-0b25-42c1-8553-15024e9ba6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.736475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0ce1-0b25-42c1-8553-15024e9ba6e0 admin admin] PATH_INFO: `/v3/projects/0cb0a6442e1c467caace7db8fa085808/users/080ffac902be4064abd566125db363a4/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.738722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0ce1-0b25-42c1-8553-15024e9ba6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb0a6442e1c467caace7db8fa085808, user_id=080ffac902be4064abd566125db363a4, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.741947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0ce1-0b25-42c1-8553-15024e9ba6e0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.759291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 776/1533] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:44 2022] PUT /identity/v3/projects/0cb0a6442e1c467caace7db8fa085808/users/080ffac902be4064abd566125db363a4/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:44.769566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.769937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.770446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.783438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 758/1534] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:44.787611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.799727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0163b-4ad1-4fd2-afdf-d842146140a1 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:44.812909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] MFA Rules not processed for user `080ffac902be4064abd566125db363a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:44.814356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:44.830965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:44.925554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:44.928776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:44.929123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:44.930444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:44.931175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:44.934271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:44.972598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 777/1535] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:44.991572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:44.993312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:45.005544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 759/1536] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:44 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:45.009241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.089319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:45.149603 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313cbc-77c1-4a1d-9df1-1755e1a7db6a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.167800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73942add-b6db-44fc-ae03-8772cf877b2c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.173242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.173650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.173936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.174210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.174849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.177197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.208193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 760/1537] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:45 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:45.213776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.222085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.222807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.223092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.223392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.230332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc625b-95db-43c7-ba85-1696296d0c60 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.237531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.238542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.239040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.239426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.240643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.244182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.263440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 761/1538] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:45.264797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.278371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd349d10-b925-498d-9139-e3090bf1ffbc admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.283990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.285455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.286028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.286498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] PATH_INFO: `/v3/projects/a39bf890746a4cb8bc85afa7373dbdd5/users/c22650847bf64fb8b8aacd6c1391fb95/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.314363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.316153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.316519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39bf890746a4cb8bc85afa7373dbdd5, user_id=c22650847bf64fb8b8aacd6c1391fb95, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.321335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.327747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 778/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:45.337266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 762/1540] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:45 2022] PUT /identity/v3/projects/a39bf890746a4cb8bc85afa7373dbdd5/users/c22650847bf64fb8b8aacd6c1391fb95/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:45.343516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.357837 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a75833-aceb-44ad-b6e6-9d5a540bad56 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.426031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.439354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.440033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.440438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.440787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.441500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.443185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.476254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 779/1541] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:45.480737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.493120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b94c41-d7ec-4b3d-aa51-2698b4ab7785 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.497940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a670b-3f21-4f36-8fe3-700a4a902e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.498980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a670b-3f21-4f36-8fe3-700a4a902e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.498980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a670b-3f21-4f36-8fe3-700a4a902e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.499159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a670b-3f21-4f36-8fe3-700a4a902e33 admin admin] PATH_INFO: `/v3/projects/a39bf890746a4cb8bc85afa7373dbdd5/users/c22650847bf64fb8b8aacd6c1391fb95/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.501240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a670b-3f21-4f36-8fe3-700a4a902e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39bf890746a4cb8bc85afa7373dbdd5, user_id=c22650847bf64fb8b8aacd6c1391fb95, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.504034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a670b-3f21-4f36-8fe3-700a4a902e33 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.506573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337a686-687c-4488-8a70-440a3e9a7b87 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.511000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.513145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.513617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.513937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.526043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 780/1542] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:45 2022] PUT /identity/v3/projects/a39bf890746a4cb8bc85afa7373dbdd5/users/c22650847bf64fb8b8aacd6c1391fb95/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:45.527654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.528237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.528237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.545551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:45.564350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] MFA Rules not processed for user `c22650847bf64fb8b8aacd6c1391fb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:45.565591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:45.576641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:45.629045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.630792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.642019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 763/1543] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:45.662899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 781/1544] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:45.771631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:45.773956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:45.789902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd503b3-c7fe-434b-8a9e-480a520d20e0 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:45.857570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:45.858339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:45.858623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:45.858896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:45.869210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:45.870850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:45.881430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 764/1545] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:45.990048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:46.003097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4010cc-8b55-4ef3-b8a5-c308affda90f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:46.007093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a052167-22b8-4c22-81d3-a5b77da3402e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:46.008303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052167-22b8-4c22-81d3-a5b77da3402e service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:46.008585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052167-22b8-4c22-81d3-a5b77da3402e service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:46.008861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052167-22b8-4c22-81d3-a5b77da3402e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:46.093525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a052167-22b8-4c22-81d3-a5b77da3402e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:46.095339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a052167-22b8-4c22-81d3-a5b77da3402e service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:46.106808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 782/1546] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:46.413535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:46.473415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba155c7-2e34-4299-922a-2cd7e154e05e service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:46.478766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:46.479390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:46.479705 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:46.479976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] PATH_INFO: `/v3/users/83e577a92048466ab21d7fbc4a0e0914` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:46.481085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e577a92048466ab21d7fbc4a0e0914)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:46.483004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:46.530211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e577a92048466ab21d7fbc4a0e0914'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:46.537049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e577a92048466ab21d7fbc4a0e0914'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:46.541913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:46.551008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e577a92048466ab21d7fbc4a0e0914'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:46.551702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e577a92048466ab21d7fbc4a0e0914'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:46.559203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e577a92048466ab21d7fbc4a0e0914'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:46.565651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 765/1547] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:46 2022] DELETE /identity/v3/users/83e577a92048466ab21d7fbc4a0e0914 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:46.570361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:46.570789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:46.571075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:46.590149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:46.591353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:46.649786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 783/1548] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:46.659358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:46.660817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:46.687675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:46.689052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:46.718966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee8062-5847-42a2-91ce-1abeee144e60 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:46.722734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:46.723345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:46.723652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:46.723923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:46.734052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:46.735549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:46.746115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 766/1549] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:46.747841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:46.759451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437515-22ed-42c6-9a91-d117c5e09e84 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:46.763565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:46.764181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:46.764466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:46.764738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:46.766503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:46.830869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:46.832353 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:46.842819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 784/1550] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:47.353771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:47.355321 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:47.379973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486290-649c-4160-9b4a-7ff9c9b7f43f service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:47.395234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:47.395935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:47.396217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:47.396871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] PATH_INFO: `/v3/projects/c6b7f3b72dca4a5bb36c9a8c0206cc6c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:47.398961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b7f3b72dca4a5bb36c9a8c0206cc6c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:47.403826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:47.529576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b7f3b72dca4a5bb36c9a8c0206cc6c', 'request_id': 'req-05d74f29-73c9-4577-9bca-06f682eaa4c1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.543673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b7f3b72dca4a5bb36c9a8c0206cc6c', 'request_id': 'req-05d74f29-73c9-4577-9bca-06f682eaa4c1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.569563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b7f3b72dca4a5bb36c9a8c0206cc6c', 'request_id': 'req-05d74f29-73c9-4577-9bca-06f682eaa4c1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.605629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] The token cache is being invalidate because project c6b7f3b72dca4a5bb36c9a8c0206cc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:47.607142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.608425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.611693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 767/1551] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:47 2022] DELETE /identity/v3/projects/c6b7f3b72dca4a5bb36c9a8c0206cc6c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:47.615672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:47.636154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ac8c-c104-45b5-8847-474e7eaa6424 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:47.778913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:47.780106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:47.781049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:47.782326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] PATH_INFO: `/v3/users/c22650847bf64fb8b8aacd6c1391fb95` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:47.786266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22650847bf64fb8b8aacd6c1391fb95)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:47.792008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:47.921289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22650847bf64fb8b8aacd6c1391fb95'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.922520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22650847bf64fb8b8aacd6c1391fb95'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.940854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22650847bf64fb8b8aacd6c1391fb95'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.952030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22650847bf64fb8b8aacd6c1391fb95'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.953053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22650847bf64fb8b8aacd6c1391fb95'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:47.971288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 785/1552] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:47 2022] DELETE /identity/v3/users/c22650847bf64fb8b8aacd6c1391fb95 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:48.897641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:48.900072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:48.919268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74f29-73c9-4577-9bca-06f682eaa4c1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.045902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.047783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.048137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.048638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] PATH_INFO: `/v3/projects/a39bf890746a4cb8bc85afa7373dbdd5` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.050553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39bf890746a4cb8bc85afa7373dbdd5)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.053164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.061386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:49.081524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.083145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.100898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c149e8-1009-4f98-9c5b-a6671d8c2e29 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.108452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.110581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.110917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.111681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] PATH_INFO: `/v3/users/4dddea7104a44108819ad0d7d26ff6ec` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.113348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dddea7104a44108819ad0d7d26ff6ec)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.115488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.129856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39bf890746a4cb8bc85afa7373dbdd5', 'request_id': 'req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.136976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:49.137330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39bf890746a4cb8bc85afa7373dbdd5', 'request_id': 'req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.146885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39bf890746a4cb8bc85afa7373dbdd5', 'request_id': 'req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.160454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] The token cache is being invalidate because project a39bf890746a4cb8bc85afa7373dbdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:49.160804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.161418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8c86fc9b-55c1-4c67-af8f-dab0389b3c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.163196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 768/1553] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:48 2022] DELETE /identity/v3/projects/a39bf890746a4cb8bc85afa7373dbdd5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:49.168209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd65ba-a5b0-482b-aeae-ceca1b752685 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.168487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd65ba-a5b0-482b-aeae-ceca1b752685 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.168772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd65ba-a5b0-482b-aeae-ceca1b752685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.193074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-adcd65ba-a5b0-482b-aeae-ceca1b752685 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:49.194356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-adcd65ba-a5b0-482b-aeae-ceca1b752685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.208054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dddea7104a44108819ad0d7d26ff6ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.209882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dddea7104a44108819ad0d7d26ff6ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.228322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dddea7104a44108819ad0d7d26ff6ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.237803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dddea7104a44108819ad0d7d26ff6ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.238465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f8be6a1b-152e-4846-8a42-6d52e9321f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dddea7104a44108819ad0d7d26ff6ec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:49.258738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 786/1554] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:49 2022] DELETE /identity/v3/users/4dddea7104a44108819ad0d7d26ff6ec => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:49.263513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.263967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.265140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.285902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 769/1555] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:49.289036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:49.290286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.293721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.294235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.294765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.321571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:49.324251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.407007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 787/1556] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:49.420111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.421654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.428823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 770/1557] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:49.433113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.457646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec23f-a230-4b81-86ca-827616c1d303 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.463526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.464915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.465214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.465493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.466156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:49.466466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.468201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.490606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 771/1558] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:10:49.493001 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.507381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6133a-f84a-4d76-9655-f9c91200519b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.509589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6b142-fd35-493f-9a78-07b3d71fd264 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.513805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.514361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.515068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.515460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.515573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.515856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.515983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.516069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.517176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.519245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.527576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.529233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.544622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 788/1559] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:49.547537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:49.559530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 772/1560] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:49 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:49.559747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.573923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2319be-539d-4584-b920-0ff750208b84 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.623065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:49.666055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.666667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.666939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.667208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.667913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.669858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.693192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 789/1561] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:49 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:49.697850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.709484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611d3f1-0b5f-458c-b714-4ffcd48b5009 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.716308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.717121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.717401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.717673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.718322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.719980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.734204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 773/1562] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:49.738296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.748907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096104-9d72-4457-8910-33f639b0ddc7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.753961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcec88-229d-4a4e-9437-508b93f2c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.754592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcec88-229d-4a4e-9437-508b93f2c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.754871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcec88-229d-4a4e-9437-508b93f2c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.755224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcec88-229d-4a4e-9437-508b93f2c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.755935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcec88-229d-4a4e-9437-508b93f2c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.758257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcec88-229d-4a4e-9437-508b93f2c9e7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.771862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 790/1563] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:49.773037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.786466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4658f-26a2-4e5b-b516-89d2972a77e1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:49.797271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:49.797997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.798283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.798684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] PATH_INFO: `/v3/projects/388b915631724c07ab72afebdceaaa97/users/c6fad1d73d114025ae29b15a7bc75104/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.815262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] RBAC: Authorizing `identity:create_grant(project_id=388b915631724c07ab72afebdceaaa97, user_id=c6fad1d73d114025ae29b15a7bc75104, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:49.817979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:49.832703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 774/1564] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:49 2022] PUT /identity/v3/projects/388b915631724c07ab72afebdceaaa97/users/c6fad1d73d114025ae29b15a7bc75104/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:49.844233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:49.844540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:49.845175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:49.872932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] MFA Rules not processed for user `c6fad1d73d114025ae29b15a7bc75104`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:49.874187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.920063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.922442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:49.951977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 791/1565] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:49.963784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:49.965155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.008149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cd6f-099e-45ea-b763-0510e3b0defc admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.013172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.014649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.015117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.015414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] PATH_INFO: `/v3/projects/098beda5e7d64dedb83bba37321f3ffe` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.016916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=098beda5e7d64dedb83bba37321f3ffe)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.018480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:50.023983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e927b-8b54-4aa1-91f5-ad6df9219975 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.027897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.028733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.029192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.029664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.039760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.041201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:50.050882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 792/1566] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:10:50.074106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:50.078852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098beda5e7d64dedb83bba37321f3ffe', 'request_id': 'req-ea911d3d-83ed-462b-b528-000550dfa68e'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.086390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098beda5e7d64dedb83bba37321f3ffe', 'request_id': 'req-ea911d3d-83ed-462b-b528-000550dfa68e'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.087606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c34f-020c-4a35-9839-f8ece05eab12 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.095715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098beda5e7d64dedb83bba37321f3ffe', 'request_id': 'req-ea911d3d-83ed-462b-b528-000550dfa68e'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.109692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] The token cache is being invalidate because project 098beda5e7d64dedb83bba37321f3ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:50.109983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.110726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.112632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 775/1567] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:49 2022] DELETE /identity/v3/projects/098beda5e7d64dedb83bba37321f3ffe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:50.116608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:50.118169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.134307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:50.165233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.166619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.166960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.167437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] PATH_INFO: `/v3/users/c6fad1d73d114025ae29b15a7bc75104` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.169722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fad1d73d114025ae29b15a7bc75104)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.172961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:50.210306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:50.218651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea911d3d-83ed-462b-b528-000550dfa68e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.230958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.232170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.232354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.232852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] PATH_INFO: `/v3/users/080ffac902be4064abd566125db363a4` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.236740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080ffac902be4064abd566125db363a4)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.240707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:50.245243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fad1d73d114025ae29b15a7bc75104'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.245970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fad1d73d114025ae29b15a7bc75104'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.283650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fad1d73d114025ae29b15a7bc75104'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.295740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fad1d73d114025ae29b15a7bc75104'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.296702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2540ff4e-9cfa-4bbc-bd33-300a950dc923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fad1d73d114025ae29b15a7bc75104'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.313022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 793/1568] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:50 2022] DELETE /identity/v3/users/c6fad1d73d114025ae29b15a7bc75104 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:50.314983 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81482-3f39-4122-9c04-4e2d91200508 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.315293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81482-3f39-4122-9c04-4e2d91200508 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.315657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81482-3f39-4122-9c04-4e2d91200508 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.323382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080ffac902be4064abd566125db363a4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.324380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 794/1569] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:10:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:10:50.325781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.326070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.326347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.335216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080ffac902be4064abd566125db363a4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.348322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:50.349767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.355517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080ffac902be4064abd566125db363a4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.356360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080ffac902be4064abd566125db363a4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.369800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d4f51e02-8e03-42be-b6a3-939aaf1d4c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080ffac902be4064abd566125db363a4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:50.398142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 776/1570] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:50 2022] DELETE /identity/v3/users/080ffac902be4064abd566125db363a4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:50.399890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.400187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.400467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.436109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:50.438127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.480290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 795/1571] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:50.494584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:50.497508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.529028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 777/1572] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:50.544912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:50.547805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.567923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f8ff-f9a8-4f53-9c98-9a3abaa9c1df None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.575816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.576431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.577316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.577944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.589016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa51845-7bd8-4803-a6ef-f734cdf9843f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.589149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.590942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:50.605706 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 778/1573] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:50.636119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:50.698106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56711e75-d2a3-475c-850d-d66ca39f8287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.698726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711e75-d2a3-475c-850d-d66ca39f8287 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.699006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711e75-d2a3-475c-850d-d66ca39f8287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.699281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711e75-d2a3-475c-850d-d66ca39f8287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.797716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56711e75-d2a3-475c-850d-d66ca39f8287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.799613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56711e75-d2a3-475c-850d-d66ca39f8287 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:50.811945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 796/1574] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:50.965327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:50.966810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:50.981689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039995b0-77a5-445f-9477-4bd6a55cf056 service nova] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:50.986754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:50.987631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:50.987755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:50.988026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] PATH_INFO: `/v3/projects/0cb0a6442e1c467caace7db8fa085808` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:50.989170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb0a6442e1c467caace7db8fa085808)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:50.991114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.055742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:51.057650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb0a6442e1c467caace7db8fa085808', 'request_id': 'req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.064266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb0a6442e1c467caace7db8fa085808', 'request_id': 'req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.074467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb0a6442e1c467caace7db8fa085808', 'request_id': 'req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.090240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] The token cache is being invalidate because project 0cb0a6442e1c467caace7db8fa085808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:51.090782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.091499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6fbcdb4e-1a7d-4fb2-ab6d-1dbc89684cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.093531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 779/1575] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:50 2022] DELETE /identity/v3/projects/0cb0a6442e1c467caace7db8fa085808 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:51.099811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.100368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.100585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.149744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:51.151234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.223183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 797/1576] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:51.231296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.231624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.231900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.252424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:51.255625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.257162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.259136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.263108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 780/1577] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:51.272536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.274550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820764-f45b-405e-a8af-21ef98c24031 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.280352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.281003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.281299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.281543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] PATH_INFO: `/v3/projects/388b915631724c07ab72afebdceaaa97` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.282994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] RBAC: Authorizing `identity:delete_project(project_id=388b915631724c07ab72afebdceaaa97)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.284173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd03a3-32db-4416-a511-2c1660d8a499 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.284952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.290009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.297536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.297981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.298447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.299348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:51.299859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.302156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.315062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 781/1578] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:51.319755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.331878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77b0b-d882-4d2f-8985-f1b7b8bb6bc1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.347892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388b915631724c07ab72afebdceaaa97', 'request_id': 'req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.354699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388b915631724c07ab72afebdceaaa97', 'request_id': 'req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.364680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388b915631724c07ab72afebdceaaa97', 'request_id': 'req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.366310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:51.385130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] The token cache is being invalidate because project 388b915631724c07ab72afebdceaaa97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:51.385517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.386395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c3c71663-0b46-4ccd-a1bb-89d6803ac31e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:51.389884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 798/1579] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:51 2022] DELETE /identity/v3/projects/388b915631724c07ab72afebdceaaa97 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:51.396145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385742a-471f-4e27-b2d0-6b33bf03d444 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.396145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385742a-471f-4e27-b2d0-6b33bf03d444 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.396145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385742a-471f-4e27-b2d0-6b33bf03d444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.412815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.414558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.415347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.415661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.416316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.418247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.434476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-5385742a-471f-4e27-b2d0-6b33bf03d444 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:51.436471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5385742a-471f-4e27-b2d0-6b33bf03d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.444781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 799/1580] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:51.452531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.452752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.453030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.457356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 782/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:51.458297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.460117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.474014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:51.475228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.542305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9c725-5bda-4639-82c7-4115e998dffa admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.547792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.548410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.548692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.549011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.549646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.551712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.553982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 800/1582] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:51.559611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.571285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90076-9993-4974-a500-e7fea8bffef9 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.576619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.577561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.577841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.578108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.579197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:51.580128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.581127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.586088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 783/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:51.587657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.598349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230b5e-3a51-436c-a1a3-610744401162 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.602460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 801/1584] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:51.606212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.606890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.607181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.607384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.608142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.608952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.610583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.621813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dbcd-448c-464b-a10b-2e1385ad2baf admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.626566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.627201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.627535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.627930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.628567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.633659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 784/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:51.633778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.636783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.651709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d89db-0cb1-407e-83e5-d25856bbb8ca admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.657223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.657837 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.658440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.658724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.659522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.661479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.663031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 802/1586] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:51.666861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.678659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 785/1587] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:51.683435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.694105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ff10b-a924-4b6a-9677-090c0ed05432 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.698989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:51.750967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213b663-d84e-4da4-b7c4-9be8db2534d9 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.758184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.758803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.759085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.759360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.760055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.762030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.769300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.770759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.771045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.771322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] PATH_INFO: `/v3/projects/536eb1433f65423cb7386f77319dc440/users/e3a231c6f94c46be84d59070575e7986/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.786101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 803/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:51.790673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.794483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536eb1433f65423cb7386f77319dc440, user_id=e3a231c6f94c46be84d59070575e7986, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.797310 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.800757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f698f5-2932-45cb-b1fd-cdbd275e46ee admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.806083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573ceb-74a1-44b1-9de4-7d065dece988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.806736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573ceb-74a1-44b1-9de4-7d065dece988 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.806967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573ceb-74a1-44b1-9de4-7d065dece988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.807240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573ceb-74a1-44b1-9de4-7d065dece988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.807908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79573ceb-74a1-44b1-9de4-7d065dece988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.809533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79573ceb-74a1-44b1-9de4-7d065dece988 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.812676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 786/1589] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:51 2022] PUT /identity/v3/projects/536eb1433f65423cb7386f77319dc440/users/e3a231c6f94c46be84d59070575e7986/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:51.821253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 804/1590] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:51.824983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.825493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.825828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.826104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.855442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] MFA Rules not processed for user `e3a231c6f94c46be84d59070575e7986`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:51.856666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:51.870439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:51.887202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9a8c6-65f2-4c93-a799-b7ace2fe5304 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.892014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.892619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.892896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.893165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.893805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.895387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.905752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 787/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:51.909840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.919992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056f48-a052-4947-83b7-5fc8a77f6cc6 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.924873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063918e8-d49f-42fc-8002-c270f307ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.925614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 805/1592] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:51.925719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063918e8-d49f-42fc-8002-c270f307ad4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.926044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063918e8-d49f-42fc-8002-c270f307ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.926378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063918e8-d49f-42fc-8002-c270f307ad4b admin admin] PATH_INFO: `/v3/projects/bbb9d03a393943aca667671a680ec3ff/users/0b5d59213908439b960a02323adf665c/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.929923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.939796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae0dae-3af7-4568-bfbc-b63292e2205f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:51.941875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063918e8-d49f-42fc-8002-c270f307ad4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb9d03a393943aca667671a680ec3ff, user_id=0b5d59213908439b960a02323adf665c, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.944218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:51.944546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063918e8-d49f-42fc-8002-c270f307ad4b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.944803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.945608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.945881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.946493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:51.948413 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:51.958672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 788/1593] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:51 2022] PUT /identity/v3/projects/bbb9d03a393943aca667671a680ec3ff/users/0b5d59213908439b960a02323adf665c/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:51.969317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:51.969881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:51.969881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:51.983043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 806/1594] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:51.987073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:51.998286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] MFA Rules not processed for user `0b5d59213908439b960a02323adf665c`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:51.999668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:52.045572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4369-cc46-41e5-b0f6-1b9963ec5742 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.050142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.050739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.051011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.051276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.051929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.053766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:52.053894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.065699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 789/1595] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:52.071092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.077539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 807/1596] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:51 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:52.081217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.084364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc3b5b-4c78-4cd4-acb4-f1265a8f48b8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.093193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0dc3f-d0e0-4542-9553-ece1e5bd3e18 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.093677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.094309 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.094596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.094869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.095714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.097692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.098456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.099159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.099469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.099750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.100492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.102524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.113596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 808/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:52.117961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.129220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a316b33-8692-47dc-afc5-f6bd97797a8d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.135675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.136342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.136619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.136894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] PATH_INFO: `/v3/projects/5af7d4ce02eb4229a7bdb8c1c617e2b2/users/9d7a57383ce2437abd00fc6fd4b03a61/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.140090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 790/1598] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:52 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:52.141746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.155883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af7d4ce02eb4229a7bdb8c1c617e2b2, user_id=9d7a57383ce2437abd00fc6fd4b03a61, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.158603 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.184125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 809/1599] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:52 2022] PUT /identity/v3/projects/5af7d4ce02eb4229a7bdb8c1c617e2b2/users/9d7a57383ce2437abd00fc6fd4b03a61/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:52.187146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.231805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e47e1-3984-4110-847d-a0c7826f9788 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.309136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:52.344093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223979-18b2-4db2-96fb-2f2bf8f3c15b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.354701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.355353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.355663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.355938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.356821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.357712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.358346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.364868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.365056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.365128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.365128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.365128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.386544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 810/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:52.393132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.406306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 791/1601] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:52 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:52.407432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.416800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546c81-1d08-49c2-bf4f-0f31904cbee1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.422912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfbe8e-98a4-44d0-b6cc-34c3b9f0ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.423916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfbe8e-98a4-44d0-b6cc-34c3b9f0ab3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.424504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfbe8e-98a4-44d0-b6cc-34c3b9f0ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.424941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfbe8e-98a4-44d0-b6cc-34c3b9f0ab3d admin admin] PATH_INFO: `/v3/projects/5af7d4ce02eb4229a7bdb8c1c617e2b2/users/9d7a57383ce2437abd00fc6fd4b03a61/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.426075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24ebf-bcd7-43b4-83c9-de910a994aa8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.427153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfbe8e-98a4-44d0-b6cc-34c3b9f0ab3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af7d4ce02eb4229a7bdb8c1c617e2b2, user_id=9d7a57383ce2437abd00fc6fd4b03a61, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.430513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfbe8e-98a4-44d0-b6cc-34c3b9f0ab3d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.433386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.434000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.434275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.434547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.435193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.437813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.444000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 811/1602] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:52 2022] PUT /identity/v3/projects/5af7d4ce02eb4229a7bdb8c1c617e2b2/users/9d7a57383ce2437abd00fc6fd4b03a61/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:52.455840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.457773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.458164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.468450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 792/1603] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:52.472601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.486916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920123e-05d4-49e5-9aab-b5b8ad9015c4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.491716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] MFA Rules not processed for user `9d7a57383ce2437abd00fc6fd4b03a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:52.493518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:52.544913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:52.553627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.554299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.555131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.555428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] PATH_INFO: `/v3/projects/3d7500efe1a8469ba985750893f33d84/users/765e5906a84f45fe82e9efff21112ca2/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.571652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7500efe1a8469ba985750893f33d84, user_id=765e5906a84f45fe82e9efff21112ca2, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.575060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.575643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 812/1604] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:52.580510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.582252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:52.596561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 793/1605] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:52 2022] PUT /identity/v3/projects/3d7500efe1a8469ba985750893f33d84/users/765e5906a84f45fe82e9efff21112ca2/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:52.597397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.600552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bed16-9864-4e47-b46d-92b944e60450 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.600681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:52.675904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427580a5-ce6f-4791-8ed5-fe20f7d356eb admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.680297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.681004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.681286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.681552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.686674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.687322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.688095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.688371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] PATH_INFO: `/v3/users/20e5373f56dc41629442314a852d2b8a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.689794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e5373f56dc41629442314a852d2b8a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.692446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.753026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e5373f56dc41629442314a852d2b8a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:52.754080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e5373f56dc41629442314a852d2b8a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:52.763680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:52.767488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.769315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e5373f56dc41629442314a852d2b8a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:52.769434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.782345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e5373f56dc41629442314a852d2b8a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:52.784145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 794/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:52.784281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-62499485-a50f-4ec7-bfa9-a5fbbb157c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e5373f56dc41629442314a852d2b8a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:52.785409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.798928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed756-c6ab-456f-8d58-7b5639d579d8 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:52.804974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:52.805719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.806180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.807159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.808379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 813/1607] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:52 2022] DELETE /identity/v3/users/20e5373f56dc41629442314a852d2b8a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:52.808552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:52.809761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:52.810053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:52.810467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:52.811420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:52.833745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 795/1608] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:52.834905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:52.835029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:52.836884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:52.843014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:52.864924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571743e-5416-4953-bd95-82ae42f55521 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:53.010459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 814/1609] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:53.013590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:53.015396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.032550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:53.034495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.035679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.036200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] PATH_INFO: `/v3/projects/3d7500efe1a8469ba985750893f33d84/users/765e5906a84f45fe82e9efff21112ca2/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.040959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7500efe1a8469ba985750893f33d84, user_id=765e5906a84f45fe82e9efff21112ca2, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:53.045285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:53.058858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 796/1610] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:52 2022] PUT /identity/v3/projects/3d7500efe1a8469ba985750893f33d84/users/765e5906a84f45fe82e9efff21112ca2/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:53.060253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:53.070813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.091607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:53.105306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04bbe-a285-4fd0-9c41-ec500b267b70 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:53.150881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef30db-2e1a-4023-82a3-485331795d57 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:53.154709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418166d-168f-4df9-b143-63ed478e3dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:53.155325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418166d-168f-4df9-b143-63ed478e3dab service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.155652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418166d-168f-4df9-b143-63ed478e3dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.155925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418166d-168f-4df9-b143-63ed478e3dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.165958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:53.166561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.166838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.167107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.168874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.216808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:53.217858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418166d-168f-4df9-b143-63ed478e3dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:53.219559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418166d-168f-4df9-b143-63ed478e3dab service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:53.229733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 797/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:53.231039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.231204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:53.231468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.231737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.232676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:53.246943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 815/1612] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:53.260820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] MFA Rules not processed for user `765e5906a84f45fe82e9efff21112ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:53.262103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.341143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 798/1613] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:53.352482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:53.354455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.371522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680509d-28d2-42ba-baae-1f62a3f15d5a service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:53.377926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:53.378888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.379276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.379586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.383051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.481806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:53.483319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:53.509823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 816/1614] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:53.662871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:53.666171 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:53.681166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1f20-2598-49a2-be77-18c4e401c08f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:53.687752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:53.688460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.688663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.688936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] PATH_INFO: `/v3/projects/763cfc5568694f3ca6018c3480081dd6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.690056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=763cfc5568694f3ca6018c3480081dd6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:53.694109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:53.786572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:53.793340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763cfc5568694f3ca6018c3480081dd6', 'request_id': 'req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:53.801257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763cfc5568694f3ca6018c3480081dd6', 'request_id': 'req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:53.810204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763cfc5568694f3ca6018c3480081dd6', 'request_id': 'req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:53.822572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] The token cache is being invalidate because project 763cfc5568694f3ca6018c3480081dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:53.822911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:53.823609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:53.828256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 799/1615] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:53 2022] DELETE /identity/v3/projects/763cfc5568694f3ca6018c3480081dd6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:53.829954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:53.843096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061547e-9476-4722-9eff-4b788ce467a9 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:53.950412 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:53.953181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:53.953181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:53.953181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] PATH_INFO: `/v3/users/4949bda31f4f48e8ab2eb75b92e3e193` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:53.959345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4949bda31f4f48e8ab2eb75b92e3e193)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:53.964578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:54.037696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4949bda31f4f48e8ab2eb75b92e3e193'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.038331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4949bda31f4f48e8ab2eb75b92e3e193'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.055578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4949bda31f4f48e8ab2eb75b92e3e193'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.064577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4949bda31f4f48e8ab2eb75b92e3e193'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.065202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9e1ff337-88da-4ac7-acfa-d43c2951b860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4949bda31f4f48e8ab2eb75b92e3e193'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.083371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 817/1616] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:53 2022] DELETE /identity/v3/users/4949bda31f4f48e8ab2eb75b92e3e193 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:54.459934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:54.462112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:54.475490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b5d1-647d-4c23-91f3-56197bc9f0fa admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:54.538652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:54.539960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:54.540239 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:54.540507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] PATH_INFO: `/v3/projects/b594ae23551c4483b5eb8bac447ef805` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:54.541804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b594ae23551c4483b5eb8bac447ef805)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:54.543953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:54.598947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b594ae23551c4483b5eb8bac447ef805', 'request_id': 'req-cc707bec-8947-4791-b306-e3aa8622cc86'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.607792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b594ae23551c4483b5eb8bac447ef805', 'request_id': 'req-cc707bec-8947-4791-b306-e3aa8622cc86'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.618758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b594ae23551c4483b5eb8bac447ef805', 'request_id': 'req-cc707bec-8947-4791-b306-e3aa8622cc86'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.638286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] The token cache is being invalidate because project b594ae23551c4483b5eb8bac447ef805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:54.638576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.639236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cc707bec-8947-4791-b306-e3aa8622cc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:54.641030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 800/1617] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:54 2022] DELETE /identity/v3/projects/b594ae23551c4483b5eb8bac447ef805 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:54.646859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:54.647313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:54.647422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:54.657089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:54.671307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:54.672600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:54.763060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 818/1618] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:54.772442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:54.773039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:54.774086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:54.800830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:54.802068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:54.814979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 801/1619] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:54.819208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:54.833703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856956-b721-49fe-83bb-d23f4b2fda99 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:54.838801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:54.839452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:54.839732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:54.840001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:54.840660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:54.840957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:54.842834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:54.857289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 819/1620] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:54.861934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:54.873036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168a56-8cad-447b-a6c1-7adba30087fd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:54.878851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:54.879584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:54.879961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:54.880398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:54.881577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:54.883680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:54.925769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 802/1621] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:54 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:54.926379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:54.944687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f8784-7a73-4f97-9599-12d30c696652 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:55.062987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:55.063945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.064233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.064506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.065273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:55.069150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:55.098014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 820/1622] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:54 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:55.102091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:55.122669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510ab9-9051-4300-809b-d73bb5fd92f6 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:55.134884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:55.136295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.136793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.137139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.137954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:55.139980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:55.152231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 803/1623] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:55.156349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:55.168618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74fc3-c508-4807-a569-ac401711b188 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:55.174855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d3571-ebbe-4282-a0c0-c425e5b9dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:55.176110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d3571-ebbe-4282-a0c0-c425e5b9dec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.176618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d3571-ebbe-4282-a0c0-c425e5b9dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.177248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d3571-ebbe-4282-a0c0-c425e5b9dec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.180504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d3571-ebbe-4282-a0c0-c425e5b9dec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:55.182425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d3571-ebbe-4282-a0c0-c425e5b9dec7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:55.203980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 821/1624] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:55.205636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:55.223324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e756a9-2d1a-4278-93be-94a432dc11f9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:55.232886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:55.233557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.233832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.234106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] PATH_INFO: `/v3/projects/6bfd2115d6cc42c0b7be119698629d11/users/f9e1e57159ab423995095af840df30a8/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.287367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfd2115d6cc42c0b7be119698629d11, user_id=f9e1e57159ab423995095af840df30a8, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:55.290723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:55.302260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:55.326407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 804/1625] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:55 2022] PUT /identity/v3/projects/6bfd2115d6cc42c0b7be119698629d11/users/f9e1e57159ab423995095af840df30a8/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:55.329528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.329749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.330036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.370740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] MFA Rules not processed for user `f9e1e57159ab423995095af840df30a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:55.372816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:55.482224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:55.485649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 822/1626] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:55.500018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:55.501897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:55.592314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bda37-16bc-48cf-b506-77dac63e3e59 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:55.597066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a57518-a87b-46bb-9d8c-5f1e37adbcf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:55.597761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a57518-a87b-46bb-9d8c-5f1e37adbcf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.598111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a57518-a87b-46bb-9d8c-5f1e37adbcf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.598451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a57518-a87b-46bb-9d8c-5f1e37adbcf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.610604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a57518-a87b-46bb-9d8c-5f1e37adbcf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:55.612229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a57518-a87b-46bb-9d8c-5f1e37adbcf0 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:55.628580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 805/1627] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:55.713388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:55.715030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:55.844407 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c43a3-348b-4c71-8fe2-8ed44211e731 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:55.853056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:55.855819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:55.856176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:55.856521 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] PATH_INFO: `/v3/users/02d2c063b69d4a5ba9e87a6db8753727` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:55.858171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d2c063b69d4a5ba9e87a6db8753727)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:55.861502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:55.924394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d2c063b69d4a5ba9e87a6db8753727'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:55.925161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d2c063b69d4a5ba9e87a6db8753727'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:55.958007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d2c063b69d4a5ba9e87a6db8753727'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:55.986409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d2c063b69d4a5ba9e87a6db8753727'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:55.987344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d2c063b69d4a5ba9e87a6db8753727'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.014868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 823/1628] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:55 2022] DELETE /identity/v3/users/02d2c063b69d4a5ba9e87a6db8753727 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:56.018633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.018926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.019211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.069690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:56.071021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:56.173110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 806/1629] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:56.185506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:56.187195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:56.298854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded12447-a6f0-4f47-9c8b-3f10b421fbdf admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:56.307834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ae5d8-e5b1-4e0c-8abb-0717d13897eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:56.307834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ae5d8-e5b1-4e0c-8abb-0717d13897eb service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.307834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ae5d8-e5b1-4e0c-8abb-0717d13897eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.307834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ae5d8-e5b1-4e0c-8abb-0717d13897eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.344568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ae5d8-e5b1-4e0c-8abb-0717d13897eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:56.344568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ae5d8-e5b1-4e0c-8abb-0717d13897eb service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:56.357058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:56.358966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:56.359298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 824/1630] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:56.375339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5e708-03cc-472d-8dcc-a43869d3dbf0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:56.382588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:56.383952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.384308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.384715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] PATH_INFO: `/v3/users/0b5d59213908439b960a02323adf665c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.386211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5d59213908439b960a02323adf665c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:56.389526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:56.460178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5d59213908439b960a02323adf665c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.474371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5d59213908439b960a02323adf665c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.498619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5d59213908439b960a02323adf665c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.499891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5d59213908439b960a02323adf665c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.515579 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5d59213908439b960a02323adf665c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.525508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 807/1631] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:56 2022] DELETE /identity/v3/users/0b5d59213908439b960a02323adf665c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:56.530944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.532416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.532916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.564182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:56.566014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:56.594031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:56.672214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 825/1632] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:56.685571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:56.688331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:56.729321 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:56.741820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:56.743321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:56.761566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94957f1-086a-4238-9471-654ed8da5ce5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:56.770346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:56.771310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.771696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.772039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] PATH_INFO: `/v3/projects/083c2d77e9c74427bea8b143e294e5d7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.773995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083c2d77e9c74427bea8b143e294e5d7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:56.775957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:56.805091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf994d4-e242-4c3f-a9ab-20f5b551ce24 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:56.810802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:56.811688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.811973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.812246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.827070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:56.828584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:56.844716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 808/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:56.851053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083c2d77e9c74427bea8b143e294e5d7', 'request_id': 'req-502412c1-2b05-43ac-8128-4e10c6600600'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.858566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083c2d77e9c74427bea8b143e294e5d7', 'request_id': 'req-502412c1-2b05-43ac-8128-4e10c6600600'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.866316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083c2d77e9c74427bea8b143e294e5d7', 'request_id': 'req-502412c1-2b05-43ac-8128-4e10c6600600'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.880721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] The token cache is being invalidate because project 083c2d77e9c74427bea8b143e294e5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:56.881184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.881859 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:56.883451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 826/1634] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:56 2022] DELETE /identity/v3/projects/083c2d77e9c74427bea8b143e294e5d7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:56.887800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:56.901310 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d27f-3de9-4016-815e-83e89b585832 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:56.990571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:56.991552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:56.991763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:56.992005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] PATH_INFO: `/v3/users/6fe14c7655424ab898994609e8f48fcd` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:56.995262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe14c7655424ab898994609e8f48fcd)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:56.997027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:57.094824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe14c7655424ab898994609e8f48fcd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.117812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe14c7655424ab898994609e8f48fcd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.137853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe14c7655424ab898994609e8f48fcd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.138511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe14c7655424ab898994609e8f48fcd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.161984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe14c7655424ab898994609e8f48fcd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.178028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 809/1635] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:56 2022] DELETE /identity/v3/users/6fe14c7655424ab898994609e8f48fcd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:57.375216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:57.378611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:57.398910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502412c1-2b05-43ac-8128-4e10c6600600 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:57.563214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:57.563887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:57.564164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:57.564436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] PATH_INFO: `/v3/projects/bbb9d03a393943aca667671a680ec3ff` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:57.566453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb9d03a393943aca667671a680ec3ff)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:57.568446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:57.649159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:57.651385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb9d03a393943aca667671a680ec3ff', 'request_id': 'req-3f5361bc-3c80-4970-a78a-0513abe1c92f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.669319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb9d03a393943aca667671a680ec3ff', 'request_id': 'req-3f5361bc-3c80-4970-a78a-0513abe1c92f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.677722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb9d03a393943aca667671a680ec3ff', 'request_id': 'req-3f5361bc-3c80-4970-a78a-0513abe1c92f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.687347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:57.690091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:57.698396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] The token cache is being invalidate because project bbb9d03a393943aca667671a680ec3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:57.698930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.706833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.708566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 827/1636] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:57 2022] DELETE /identity/v3/projects/bbb9d03a393943aca667671a680ec3ff => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:57.713054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:57.714459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f678a-44b1-43ef-aa39-2b484516a347 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:57.716063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:57.762371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:57.796436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:57.797098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:57.797381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:57.797669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] PATH_INFO: `/v3/projects/1efc388b8c364d0eb88c84787ac3871e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:57.798795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efc388b8c364d0eb88c84787ac3871e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:57.800771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:57.803678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5361bc-3c80-4970-a78a-0513abe1c92f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:57.808449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:57.809076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:57.809358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:57.809627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] PATH_INFO: `/v3/users/765e5906a84f45fe82e9efff21112ca2` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:57.810744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765e5906a84f45fe82e9efff21112ca2)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:57.812870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:57.855160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efc388b8c364d0eb88c84787ac3871e', 'request_id': 'req-b848f7f2-9835-49f9-94de-55245390aa49'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.862208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efc388b8c364d0eb88c84787ac3871e', 'request_id': 'req-b848f7f2-9835-49f9-94de-55245390aa49'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.866774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765e5906a84f45fe82e9efff21112ca2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.867656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765e5906a84f45fe82e9efff21112ca2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.870320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efc388b8c364d0eb88c84787ac3871e', 'request_id': 'req-b848f7f2-9835-49f9-94de-55245390aa49'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.881447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765e5906a84f45fe82e9efff21112ca2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.883540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] The token cache is being invalidate because project 1efc388b8c364d0eb88c84787ac3871e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:57.883826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.884462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b848f7f2-9835-49f9-94de-55245390aa49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.886127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 810/1637] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:57 2022] DELETE /identity/v3/projects/1efc388b8c364d0eb88c84787ac3871e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:57.890466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765e5906a84f45fe82e9efff21112ca2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.891231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8ecf6539-9b76-4c5c-aee4-e35bf9e1ba38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765e5906a84f45fe82e9efff21112ca2'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:57.891715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:57.892083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:57.892315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:57.905917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 828/1638] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:57 2022] DELETE /identity/v3/users/765e5906a84f45fe82e9efff21112ca2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:57.913374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:57.914584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:57.978211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 811/1639] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:57.986613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:57.986930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:57.987213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.007076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:58.008897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:58.017235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 829/1640] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:58.021373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.032023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20695-4b6d-457d-994c-c5ed5e372af2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.036666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.037488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.037609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.037795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.038435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:58.038735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.040381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.053207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 812/1641] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:58.057068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.067552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628bada-df75-40f4-b53a-7b7fcb130385 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.075609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.076393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.076819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.077258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.078178 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.080985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.116543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 830/1642] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:58.120785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.134903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020e49d-aabd-4bc3-b2c1-109bd0c9864d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.232854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:58.271200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.272032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.272350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.272902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.273280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.275763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.297533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.299297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:58.317852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7347-7e89-4130-8561-b37dc70da17e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.328491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 813/1643] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:58.330715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.331439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.331746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.332010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] PATH_INFO: `/v3/projects/3d7500efe1a8469ba985750893f33d84` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.333405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.334378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7500efe1a8469ba985750893f33d84)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.336400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.349283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be36c5-23ce-444e-9e93-d42bdc3dac2c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.369446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:58.369773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.370661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.371015 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.371341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.372089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.374230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.387818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 814/1644] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:58.391574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.403297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549e9-f709-4bc8-9806-c69b9269d889 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.405299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7500efe1a8469ba985750893f33d84', 'request_id': 'req-163301e3-7dbe-4f42-b87b-e0557ae687d5'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:58.413021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7500efe1a8469ba985750893f33d84', 'request_id': 'req-163301e3-7dbe-4f42-b87b-e0557ae687d5'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:58.423292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7500efe1a8469ba985750893f33d84', 'request_id': 'req-163301e3-7dbe-4f42-b87b-e0557ae687d5'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:58.434863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] The token cache is being invalidate because project 3d7500efe1a8469ba985750893f33d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:10:58.435153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:58.435828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-163301e3-7dbe-4f42-b87b-e0557ae687d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:58.437493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 831/1645] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:10:58 2022] DELETE /identity/v3/projects/3d7500efe1a8469ba985750893f33d84 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:58.442082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24183-e962-4785-9de1-1f3d9a1d0d3f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.442434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24183-e962-4785-9de1-1f3d9a1d0d3f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.442780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24183-e962-4785-9de1-1f3d9a1d0d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.462297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-9cc24183-e962-4785-9de1-1f3d9a1d0d3f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:58.462523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.463130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.463436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.463721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.463823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9cc24183-e962-4785-9de1-1f3d9a1d0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:58.464361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.465943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.471456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 832/1646] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:10:58.475639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 815/1647] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:10:58.479475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.479762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.479872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.480037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.481478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:58.495845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f3083-e4b1-4277-8efb-4740805f50fe admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.501027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d18bb8-6316-4801-83aa-bd4295342240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.501692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d18bb8-6316-4801-83aa-bd4295342240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.501977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d18bb8-6316-4801-83aa-bd4295342240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.502256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d18bb8-6316-4801-83aa-bd4295342240 admin admin] PATH_INFO: `/v3/projects/d09df39e51fe468dab8c88e0db9e655c/users/959fb2f9fb3e47cf9fd7ac649738011f/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.502508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:58.503753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:58.512498 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 833/1648] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:58.518351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d18bb8-6316-4801-83aa-bd4295342240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09df39e51fe468dab8c88e0db9e655c, user_id=959fb2f9fb3e47cf9fd7ac649738011f, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.521076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d18bb8-6316-4801-83aa-bd4295342240 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.522602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.537151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035645a-261a-49ba-92f5-a8ac502eba2c None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.547134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 816/1649] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:58 2022] PUT /identity/v3/projects/d09df39e51fe468dab8c88e0db9e655c/users/959fb2f9fb3e47cf9fd7ac649738011f/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:10:58.548887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.549178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.549459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.596007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] MFA Rules not processed for user `959fb2f9fb3e47cf9fd7ac649738011f`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:58.597920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:58.627422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.628420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.628929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.629774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.630796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:10:58.631270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.633939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.650393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 834/1650] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:10:58.654688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.666105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bedcb-f36b-49cb-983a-a303c5352004 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.673035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.673652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.673952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.674258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.674892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.676899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.696431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 817/1651] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:58.701944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.718285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f6a62-fa96-4eee-ba93-db22a1f8d900 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.724512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.724948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.726632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.726632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.726632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.731613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:58.755060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 835/1652] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:10:58.756016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.813673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 818/1653] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:58.815991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:58.842466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:58.901741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263312bd-751b-4a60-8995-cdc28d67cfbd admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.925055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:58.967260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b071aa7-fb84-4e44-8c3d-4a2d08ac92f0 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:58.982554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:58.983865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:58.984225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:58.984573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:58.985687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:58.988342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.015885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 819/1654] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:59.017000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.018968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.020879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.029242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.029242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.029242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.029242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.029242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.038229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762bf1-bb32-4c6c-9528-597da80e90c9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.046614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.047380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.047712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.048371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] PATH_INFO: `/v3/users/e3a231c6f94c46be84d59070575e7986` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.049697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a231c6f94c46be84d59070575e7986)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.051378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 836/1655] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:10:58 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:10:59.052250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.055571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.061903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43863d4-a5c8-46ce-955f-61262d9ace0b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.066687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.067287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.067598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.067874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.068528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.070179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.083479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 837/1656] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:59.083479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.092607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acee040-0a02-4db8-ac78-543159f1c15c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.097933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.098714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.098841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.099208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.100006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.102374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.115555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 838/1657] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:59.115555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.124470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a231c6f94c46be84d59070575e7986'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:59.127970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56c8c-4a66-40b2-b7d8-efaf95ba320f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.133485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.134726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.135079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.135477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] PATH_INFO: `/v3/projects/8051cf647f304350a835216a9f2f8472/users/e9352f86b6824a4bbcacab7502b62566/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.135834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a231c6f94c46be84d59070575e7986'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:59.150834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a231c6f94c46be84d59070575e7986'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:59.151701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a231c6f94c46be84d59070575e7986'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:59.152084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8051cf647f304350a835216a9f2f8472, user_id=e9352f86b6824a4bbcacab7502b62566, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.154648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.160394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a231c6f94c46be84d59070575e7986'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:10:59.168292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 839/1658] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:59 2022] PUT /identity/v3/projects/8051cf647f304350a835216a9f2f8472/users/e9352f86b6824a4bbcacab7502b62566/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:59.169105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 820/1659] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:10:59 2022] DELETE /identity/v3/users/e3a231c6f94c46be84d59070575e7986 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:59.171511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.172566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.173174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.173947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.244214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35e338-ea35-4cd8-9250-0e0c4bccadce admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.249394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82d679-da0b-4b92-bcfc-19de9c589319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.250003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82d679-da0b-4b92-bcfc-19de9c589319 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.250276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82d679-da0b-4b92-bcfc-19de9c589319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.250544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82d679-da0b-4b92-bcfc-19de9c589319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.250724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3f81-de38-4105-acbc-a6541058d9bd admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.251185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82d679-da0b-4b92-bcfc-19de9c589319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.252830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82d679-da0b-4b92-bcfc-19de9c589319 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.255972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.256578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.256859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.257134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.259611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.260080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.264441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 840/1660] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:59.269204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.269659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.270068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.275144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 821/1661] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:10:59.276085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.286793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5390b5-47ce-4f74-8a6d-3d867d4650a3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.306831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:59.308276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.309900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5ea94-1d1b-4541-ad63-f4c52d0b615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.310578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ea94-1d1b-4541-ad63-f4c52d0b615f admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.314336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ea94-1d1b-4541-ad63-f4c52d0b615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.314648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5ea94-1d1b-4541-ad63-f4c52d0b615f admin admin] PATH_INFO: `/v3/projects/7e35f4771401496887597f950b4d497b/users/5896122596e94c839695b9356e7dcb63/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.318845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 841/1662] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:59.320027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.327023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:59.335785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35419cf-c346-4512-b3df-c622c2b188b4 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.345974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.347085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.347684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.347827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] PATH_INFO: `/v3/projects/8051cf647f304350a835216a9f2f8472/users/e9352f86b6824a4bbcacab7502b62566/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.350063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8051cf647f304350a835216a9f2f8472, user_id=e9352f86b6824a4bbcacab7502b62566, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.351620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5ea94-1d1b-4541-ad63-f4c52d0b615f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e35f4771401496887597f950b4d497b, user_id=5896122596e94c839695b9356e7dcb63, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.354946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.358043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5ea94-1d1b-4541-ad63-f4c52d0b615f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.381776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 842/1663] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:59 2022] PUT /identity/v3/projects/8051cf647f304350a835216a9f2f8472/users/e9352f86b6824a4bbcacab7502b62566/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:59.381776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.381776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.407550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 822/1664] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:10:59 2022] PUT /identity/v3/projects/7e35f4771401496887597f950b4d497b/users/5896122596e94c839695b9356e7dcb63/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:10:59.417986 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758b0e5-4f7e-4aa7-a5a8-39fa28e96aff None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.418594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758b0e5-4f7e-4aa7-a5a8-39fa28e96aff None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.419049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758b0e5-4f7e-4aa7-a5a8-39fa28e96aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.448635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:59.470683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a758b0e5-4f7e-4aa7-a5a8-39fa28e96aff None None] MFA Rules not processed for user `e9352f86b6824a4bbcacab7502b62566`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:59.472423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a758b0e5-4f7e-4aa7-a5a8-39fa28e96aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.485875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b87138-f4b9-4ed8-b1e9-24a403ada889 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.552863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.553694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.554040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.555269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.580296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 823/1665] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:59.589361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.589952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.590369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.625331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.626771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.630317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] MFA Rules not processed for user `5896122596e94c839695b9356e7dcb63`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:10:59.631593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.637315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 843/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:59.638187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.639576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.705058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 824/1667] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:10:59.706722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152743e-7cee-4123-be9d-c9592db179a8 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.712338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.712961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.713240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.713512 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.722449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.723108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:10:59.724598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:10:59.739612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1183-8154-48e6-9f7b-a3366c509489 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:10:59.743934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:10:59.744779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:10:59.744906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:10:59.745233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:10:59.757488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.790306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.794222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:59.798411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:10:59.800532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:10:59.812928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 844/1668] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:10:59.824768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 825/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:10:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:11:00.010819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:00.013119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:00.041575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2a9ed-7102-4c15-9af7-767ede3de284 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:00.052431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:00.053769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:00.055852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:00.056296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] PATH_INFO: `/v3/projects/536eb1433f65423cb7386f77319dc440` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:00.060045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=536eb1433f65423cb7386f77319dc440)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:00.062200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:00.190076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536eb1433f65423cb7386f77319dc440', 'request_id': 'req-9ba219cb-4fc4-4878-b020-024f28715fcf'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.208524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536eb1433f65423cb7386f77319dc440', 'request_id': 'req-9ba219cb-4fc4-4878-b020-024f28715fcf'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.227017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536eb1433f65423cb7386f77319dc440', 'request_id': 'req-9ba219cb-4fc4-4878-b020-024f28715fcf'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.242110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] The token cache is being invalidate because project 536eb1433f65423cb7386f77319dc440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:00.242445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.243780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.250021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 845/1670] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:00 2022] DELETE /identity/v3/projects/536eb1433f65423cb7386f77319dc440 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:00.254462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:00.271828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4170dc-f889-44f9-a0f8-e5af16309f3f service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:00.439087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:00.491830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:00.492961 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:00.498365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:00.498821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] PATH_INFO: `/v3/users/9d7a57383ce2437abd00fc6fd4b03a61` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:00.500772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7a57383ce2437abd00fc6fd4b03a61)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:00.509778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:00.594780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7a57383ce2437abd00fc6fd4b03a61'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.606492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7a57383ce2437abd00fc6fd4b03a61'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.622173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7a57383ce2437abd00fc6fd4b03a61'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.623550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7a57383ce2437abd00fc6fd4b03a61'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.647285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7952aaa9-dc01-45df-8041-2fd84abbafaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7a57383ce2437abd00fc6fd4b03a61'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:00.661618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 826/1671] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:00 2022] DELETE /identity/v3/users/9d7a57383ce2437abd00fc6fd4b03a61 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:01.521632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:01.523175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:01.540277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:01.540777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:01.540849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:01.543252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba219cb-4fc4-4878-b020-024f28715fcf admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:01.564121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] MFA Rules not processed for user `5896122596e94c839695b9356e7dcb63`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:01.565348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:01.615139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:01.615957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:01.616238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:01.616511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] PATH_INFO: `/v3/projects/5af7d4ce02eb4229a7bdb8c1c617e2b2` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:01.617970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af7d4ce02eb4229a7bdb8c1c617e2b2)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:01.620075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:01.656501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 827/1672] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:01.696101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af7d4ce02eb4229a7bdb8c1c617e2b2', 'request_id': 'req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:01.704509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af7d4ce02eb4229a7bdb8c1c617e2b2', 'request_id': 'req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:01.733822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af7d4ce02eb4229a7bdb8c1c617e2b2', 'request_id': 'req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:01.754568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:01.756351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:01.766006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] The token cache is being invalidate because project 5af7d4ce02eb4229a7bdb8c1c617e2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:01.767285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:01.768312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b52acb6a-fe34-4fac-8b0a-e08ff26b9107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:01.770629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 846/1673] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:01 2022] DELETE /identity/v3/projects/5af7d4ce02eb4229a7bdb8c1c617e2b2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:01.776560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07630ec-7fee-4fc1-a739-e6a052da31af None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:01.777318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cba69-dd12-4de2-81de-809b350cbf5b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:01.777924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cba69-dd12-4de2-81de-809b350cbf5b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:01.778686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cba69-dd12-4de2-81de-809b350cbf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:01.804711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-512cba69-dd12-4de2-81de-809b350cbf5b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:01.806459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-512cba69-dd12-4de2-81de-809b350cbf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:01.811607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:01.877340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:01.877999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:01.878279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:01.878557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] PATH_INFO: `/v3/users/f9e1e57159ab423995095af840df30a8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:01.880071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e1e57159ab423995095af840df30a8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:01.882165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:01.951531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:01.964192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 847/1674] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:01.965660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:01.966049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:01.966264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.000763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:02.002010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:02.012115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e1e57159ab423995095af840df30a8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:02.017104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 848/1675] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:02.018040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.022557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e1e57159ab423995095af840df30a8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:02.030191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acd6d1-a5ab-4b2d-9346-0e6dabe9c1f7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.035922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.036648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.036930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.037204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.037955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:02.038263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.040325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.041323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e1e57159ab423995095af840df30a8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:02.042486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e1e57159ab423995095af840df30a8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:02.054160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15b547c6-e413-403d-ac8a-6cc243273896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e1e57159ab423995095af840df30a8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:02.058964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 849/1676] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:11:02.059938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.062140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:02.067422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 828/1677] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:01 2022] DELETE /identity/v3/users/f9e1e57159ab423995095af840df30a8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:02.072231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.072515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.073050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.076688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a4414-67a0-43c2-bda9-0218d4bfc1eb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.093590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:02.094899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:02.140219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.141040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.141651 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.141934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.142634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.144580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.186493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 850/1678] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:02 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:02.191058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.248862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 829/1679] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:11:02.281253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.283203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:02.415066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a047-fbc0-438b-a85c-0a9bc9b73584 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.426703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.427478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.427760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.428149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.429559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.432832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.465864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e599-1d0c-4c77-ba5e-2034036ef441 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.475584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 851/1680] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:02 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:02.481534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.500183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:02.509210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a90d6-b750-43c9-b34c-eaf8771d6d52 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.529636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.531889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.532532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.532921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.533751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.536020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.551850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 852/1681] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:02.556274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.581845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce804c-c3db-4b8f-95ae-cb363910417f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.581982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:02.604735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.606665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.606951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.608388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.609065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.613624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.616984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5af3-9cc5-4afc-a0ad-4773164e3d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.618682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5af3-9cc5-4afc-a0ad-4773164e3d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.619569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5af3-9cc5-4afc-a0ad-4773164e3d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.620077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5af3-9cc5-4afc-a0ad-4773164e3d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.634673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5af3-9cc5-4afc-a0ad-4773164e3d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.637020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5af3-9cc5-4afc-a0ad-4773164e3d5c service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.641036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 853/1682] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:02.646130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.668582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ca5b-f6cf-4e98-99ad-98f05acf1f56 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:02.676014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:02.677686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.678117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.678697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] PATH_INFO: `/v3/projects/dd2b97f38f644715b5717b728fab090e/users/a8ea2d33b85343ca994fe2d93b226bee/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.686671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 830/1683] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:11:02.738006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2b97f38f644715b5717b728fab090e, user_id=a8ea2d33b85343ca994fe2d93b226bee, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:02.740943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:02.795706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 854/1684] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:02 2022] PUT /identity/v3/projects/dd2b97f38f644715b5717b728fab090e/users/a8ea2d33b85343ca994fe2d93b226bee/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:02.806995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04276a6-17be-4583-af96-95319358a8ac None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:02.807283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04276a6-17be-4583-af96-95319358a8ac None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:02.807596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04276a6-17be-4583-af96-95319358a8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:02.858113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f04276a6-17be-4583-af96-95319358a8ac None None] MFA Rules not processed for user `a8ea2d33b85343ca994fe2d93b226bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:02.860031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f04276a6-17be-4583-af96-95319358a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:02.969849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 831/1685] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:02.971163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.992370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04276a6-17be-4583-af96-95319358a8ac None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:02.994925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f04276a6-17be-4583-af96-95319358a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:03.099663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92725f10-7441-4dae-a1d4-2f1e917f8fdb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.108924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04276a6-17be-4583-af96-95319358a8ac None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.113042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.113668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.113948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.114233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.115573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.118106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.122223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.122944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.123884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.123884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.126186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:03.153955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 855/1686] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:02 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:03.157748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.256594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f924b-3586-404e-a919-2074ef9037af admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.264358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.265491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.265806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.266035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.266715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.268675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.275259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.276958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.293940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 832/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:03.294993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.296497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:03.297183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 856/1688] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:03 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:03.300922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.312695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127bbf7-e9c0-4bef-9ae4-06712b5b31f0 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.315723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55ff8-31a5-477e-a3b8-568c53da42b2 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.317842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.318572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.318952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.319382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] PATH_INFO: `/v3/projects/6bfd2115d6cc42c0b7be119698629d11` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.321211 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfd2115d6cc42c0b7be119698629d11)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.322383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.323178 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.323475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.323823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.324235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.325013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.326936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.344501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 857/1689] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:03.346763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.358820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:03.362537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73256bfe-4c48-4b53-a0f3-89de3c7c2fc8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.370273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.370954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.371517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.371905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.372621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.374542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.389997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 858/1690] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:03.393853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.410823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7b74f-a7f0-439e-952b-5445930b52f3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.420845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfd2115d6cc42c0b7be119698629d11', 'request_id': 'req-0149ca81-e743-417f-bdf3-eff8f048060f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:03.430078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:03.434918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfd2115d6cc42c0b7be119698629d11', 'request_id': 'req-0149ca81-e743-417f-bdf3-eff8f048060f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:03.445150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfd2115d6cc42c0b7be119698629d11', 'request_id': 'req-0149ca81-e743-417f-bdf3-eff8f048060f'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:03.459877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] The token cache is being invalidate because project 6bfd2115d6cc42c0b7be119698629d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:03.460427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:03.463829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0149ca81-e743-417f-bdf3-eff8f048060f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:03.465762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 833/1691] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:03 2022] DELETE /identity/v3/projects/6bfd2115d6cc42c0b7be119698629d11 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:03.470315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829daaa3-1531-486f-9579-e812009589a6 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.471942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829daaa3-1531-486f-9579-e812009589a6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.472869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829daaa3-1531-486f-9579-e812009589a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.519345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0cb8-7404-4156-8c5f-f182b5c1d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.519665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-829daaa3-1531-486f-9579-e812009589a6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:03.520509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0cb8-7404-4156-8c5f-f182b5c1d7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.520885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0cb8-7404-4156-8c5f-f182b5c1d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.521033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-829daaa3-1531-486f-9579-e812009589a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:03.521334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0cb8-7404-4156-8c5f-f182b5c1d7ca admin admin] PATH_INFO: `/v3/projects/9bff0f0bcc91495ba03c28716eb42646/users/6998897bac194102b0d5a4362c658abe/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.531319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 834/1692] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:03.538738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.540085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.540474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.565264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0cb8-7404-4156-8c5f-f182b5c1d7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bff0f0bcc91495ba03c28716eb42646, user_id=6998897bac194102b0d5a4362c658abe, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.568329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0cb8-7404-4156-8c5f-f182b5c1d7ca admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.577085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:03.578317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:03.596006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 859/1693] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:03 2022] PUT /identity/v3/projects/9bff0f0bcc91495ba03c28716eb42646/users/6998897bac194102b0d5a4362c658abe/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:03.609541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.609767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.610029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.623427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 835/1694] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:11:03.635078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.663716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b124-c469-4b62-a638-9b0ffb30c516 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.716489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] MFA Rules not processed for user `6998897bac194102b0d5a4362c658abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:03.718210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:03.874629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.875341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.875863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.876459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.877212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:03.877586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.887846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.934737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 836/1695] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:11:03.938950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.964059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635735d7-938d-4689-8938-e1f0781bd38f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:03.977954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:03.978913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:03.979382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:03.980118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:03.980931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:03.983048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:03.983883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 860/1696] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:03.988378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:03.994544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:04.033994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e7d9e-ba61-4527-8d3b-14777e27d89a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.048656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.049469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.050967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.051359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.052668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.059717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 837/1697] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:03 2022] POST /identity/v3/projects => generated 361 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:04.062872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.063324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.109823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 861/1698] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:03 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:04.113937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.162047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927319dd-880b-413e-93c0-5570f2f23d25 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.176260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:04.226140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c097e28-c2b2-4da5-83c7-3e83bc5aefd9 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.232929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.233745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.234026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.234299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.235263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.237567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.250954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.251621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:04.252915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.253381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.253917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.255831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.260731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.276689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 862/1699] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:04 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:04.279184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.291599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22163a-2ffc-4005-92c2-c46f072fd7bb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.292754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 838/1700] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:04 2022] POST /identity/v3/users => generated 281 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:04.297349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.305690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.306324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.306610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.307017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.307724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.310036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.314076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a5961-fb7d-48f9-a523-94c3d603b559 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.322151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.323967 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.327293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 863/1701] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:04.328114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.328324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.328425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.329806 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.334933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.341963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eb10f-ea79-40bd-afa7-40b82acd7b4e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.348870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.349588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.349872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.350273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] PATH_INFO: `/v3/projects/3baa91067eb443a6b637614dc3f6c08b/users/505e1ac479c94e44b147313fe4d73e14/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.353847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 839/1702] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:04.358616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.376619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112c186-e06e-41ba-8bec-0a3d2b5000ba admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.378016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3baa91067eb443a6b637614dc3f6c08b, user_id=505e1ac479c94e44b147313fe4d73e14, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.384193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.385582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.386554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.386970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.387248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.388050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.390743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.412587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 840/1703] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:04.413802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.425921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 864/1704] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:04 2022] PUT /identity/v3/projects/3baa91067eb443a6b637614dc3f6c08b/users/505e1ac479c94e44b147313fe4d73e14/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:04.430978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.434725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9f61-eb68-44d8-88ea-f3480ecd4620 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.576182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0359ad-dfe2-46ed-80da-339a014b6a8c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.597408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee474a05-66f3-4d7c-9032-711c0c1dcfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.613483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474a05-66f3-4d7c-9032-711c0c1dcfed admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.613798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474a05-66f3-4d7c-9032-711c0c1dcfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.614045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474a05-66f3-4d7c-9032-711c0c1dcfed admin admin] PATH_INFO: `/v3/projects/df8fcbdc022f4308912a237a2ec64fd2/users/4e6c518b124843839ba606332a714f1a/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.622720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.623391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.623870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.624145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.624806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.629174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.677629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 865/1705] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:04.680713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474a05-66f3-4d7c-9032-711c0c1dcfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8fcbdc022f4308912a237a2ec64fd2, user_id=4e6c518b124843839ba606332a714f1a, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.683258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:04.693588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474a05-66f3-4d7c-9032-711c0c1dcfed admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.705481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39638f-2e5c-4f7c-a0c9-56d8fa816684 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:04.721261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 841/1706] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:04 2022] PUT /identity/v3/projects/df8fcbdc022f4308912a237a2ec64fd2/users/4e6c518b124843839ba606332a714f1a/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:04.733891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620f30a-6358-4dc3-ba53-7b5d9099c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:04.734556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.735126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620f30a-6358-4dc3-ba53-7b5d9099c7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.735426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620f30a-6358-4dc3-ba53-7b5d9099c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.737636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.737962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.738336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620f30a-6358-4dc3-ba53-7b5d9099c7c2 admin admin] PATH_INFO: `/v3/projects/3baa91067eb443a6b637614dc3f6c08b/users/505e1ac479c94e44b147313fe4d73e14/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.747978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620f30a-6358-4dc3-ba53-7b5d9099c7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3baa91067eb443a6b637614dc3f6c08b, user_id=505e1ac479c94e44b147313fe4d73e14, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:04.755395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620f30a-6358-4dc3-ba53-7b5d9099c7c2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:04.793423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 866/1707] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:04 2022] PUT /identity/v3/projects/3baa91067eb443a6b637614dc3f6c08b/users/505e1ac479c94e44b147313fe4d73e14/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:04.806008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:04.806301 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:04.806579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:04.818141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] MFA Rules not processed for user `4e6c518b124843839ba606332a714f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:04.819713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:04.858037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] MFA Rules not processed for user `505e1ac479c94e44b147313fe4d73e14`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:04.860668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:04.987042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:05.018418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 842/1708] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:05.029354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 867/1709] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:05.036883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:05.038320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:05.109719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:05.111881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:05.128144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1d9b7-331d-499b-b49e-eee076849217 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:05.132573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:05.133751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:05.134043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:05.134317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:05.136100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:05.145590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:05.188009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1d6c-e48b-4e7e-8d8b-be82d28089f5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:05.194606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:05.196234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:05.196704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:05.196979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:05.206756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:05.208218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:05.208703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:05.210303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2f4f1-1612-4b88-9aa8-83c2dde4cad7 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:05.218644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 868/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:05.220572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 843/1711] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:05.244880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:05.350677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68074-5c38-48f5-abb6-c36ed5526248 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:05.355781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:05.356509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:05.356707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:05.356988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] PATH_INFO: `/v3/users/4e6c518b124843839ba606332a714f1a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:05.358552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6c518b124843839ba606332a714f1a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:05.360768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:05.424010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6c518b124843839ba606332a714f1a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:05.424931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6c518b124843839ba606332a714f1a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:05.439655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6c518b124843839ba606332a714f1a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:05.449611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6c518b124843839ba606332a714f1a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:05.450267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6c518b124843839ba606332a714f1a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:05.464397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 869/1712] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:05 2022] DELETE /identity/v3/users/4e6c518b124843839ba606332a714f1a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:05.468935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:05.469236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:05.469534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:05.489554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:05.490785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:05.598161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 844/1713] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:05.608330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:05.609752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:05.745606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:05.760810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daaac0-c9aa-4aef-9746-0ab1aeac4cec admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:05.776307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701f3b-0680-48df-94d6-26239812e302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:05.777053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701f3b-0680-48df-94d6-26239812e302 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:05.777346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701f3b-0680-48df-94d6-26239812e302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:05.777803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701f3b-0680-48df-94d6-26239812e302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:05.790624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701f3b-0680-48df-94d6-26239812e302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:05.793760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701f3b-0680-48df-94d6-26239812e302 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:05.824609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 870/1714] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:06.207854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.209606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:06.231163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef315a-3257-4338-913a-6e30b2ae1012 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.238240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.239153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.239546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.239866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] PATH_INFO: `/v3/projects/df8fcbdc022f4308912a237a2ec64fd2` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.241139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8fcbdc022f4308912a237a2ec64fd2)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:06.256242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:06.344836 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8fcbdc022f4308912a237a2ec64fd2', 'request_id': 'req-71b403cd-fff6-4758-be16-f87edae60e43'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:06.348998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:06.375462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8fcbdc022f4308912a237a2ec64fd2', 'request_id': 'req-71b403cd-fff6-4758-be16-f87edae60e43'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:06.383823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8fcbdc022f4308912a237a2ec64fd2', 'request_id': 'req-71b403cd-fff6-4758-be16-f87edae60e43'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:06.400434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] The token cache is being invalidate because project df8fcbdc022f4308912a237a2ec64fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:06.401224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:06.403166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71b403cd-fff6-4758-be16-f87edae60e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:06.409051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 845/1715] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:06 2022] DELETE /identity/v3/projects/df8fcbdc022f4308912a237a2ec64fd2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:06.410761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.411052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.411324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.434761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:06.436593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:06.516998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 871/1716] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:06.525624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.525910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.526184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.548375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:06.549688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:06.558308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 846/1717] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:06.563256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.574351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da506004-a9f3-4717-bce5-20cca74ecb3a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.580439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.581397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.581817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.582101 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.583089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:06.583419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:06.585194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:06.607870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 872/1718] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:11:06.608994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.620459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333faceb-0401-42a7-a9bf-2abc2415fb5f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.631618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.632250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.632583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.632789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.633874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:06.638041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:06.693547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 847/1719] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:06 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:06.696763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.710068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130756d-001c-4ebd-a2fa-700c5c7d77b3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.852993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.853719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.854103 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.854450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.855452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:06.857477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:06.890326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 873/1720] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:06 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:06.892817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.912916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d398a42-f872-4564-9dd3-0524f07485d7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.919855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.921082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.921368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.921796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.922966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:06.924884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:06.938723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 848/1721] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:06.940148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.951187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390a0c-1476-420c-b855-871ec9cbaaed admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.956845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.957545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.958066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.958439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:06.959100 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:06.960751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:06.976338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 874/1722] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:06.978707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:06.990634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7edd9-d883-4afb-a2e9-6b3fd0a48948 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:06.995983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2c57b-25e8-4399-8841-640cbd0465cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:06.996923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2c57b-25e8-4399-8841-640cbd0465cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:06.997413 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2c57b-25e8-4399-8841-640cbd0465cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:06.997886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2c57b-25e8-4399-8841-640cbd0465cc admin admin] PATH_INFO: `/v3/projects/08d335e2fc1440e5a17ae65bcd8358cc/users/9286b1b118e84552bc6118d15c92972a/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:07.015489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2c57b-25e8-4399-8841-640cbd0465cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d335e2fc1440e5a17ae65bcd8358cc, user_id=9286b1b118e84552bc6118d15c92972a, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:07.017444 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:07.018177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2c57b-25e8-4399-8841-640cbd0465cc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:07.019757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:07.036557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 849/1723] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:06 2022] PUT /identity/v3/projects/08d335e2fc1440e5a17ae65bcd8358cc/users/9286b1b118e84552bc6118d15c92972a/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:07.041560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:07.042104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:07.042573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:07.066216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:07.067779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:07.108214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ba69f-0a9a-4a8a-9759-3e7faae85e9c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:07.120299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:07.146651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 850/1724] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:11:07.162486 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:07.163942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:07.201432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:07.202317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:07.202776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:07.203058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:07.205067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:07.292679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af80c0e-464b-49bb-9285-ab5aecb183a7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:07.324811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:07.326317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:07.326317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:07.328125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:07.349475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:07.350942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:07.362075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 851/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:11:07.362345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:07.364590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:07.381213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 875/1726] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:11:08.089589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:08.099997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a409b-aa09-408d-9b52-da8de5fabd32 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:08.104368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:08.105465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:08.105897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:08.106318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:08.108636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:08.123912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:08.206608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:08.209382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9aa1b-6696-4750-84e0-e02d441d3c8a service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:08.226897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 852/1727] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:12.750952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:12.752868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:12.784621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9590bf-7adf-4c2e-b049-380bef1d49c7 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:12.794787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:12.795841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:12.797448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:12.798018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] PATH_INFO: `/v3/users/a8ea2d33b85343ca994fe2d93b226bee` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:12.799463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ea2d33b85343ca994fe2d93b226bee)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:12.801863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:12.890569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ea2d33b85343ca994fe2d93b226bee'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:12.891749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ea2d33b85343ca994fe2d93b226bee'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:12.908910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ea2d33b85343ca994fe2d93b226bee'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:12.922035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ea2d33b85343ca994fe2d93b226bee'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:12.924263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ea2d33b85343ca994fe2d93b226bee'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:12.949023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:12.949940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 876/1728] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:12 2022] DELETE /identity/v3/users/a8ea2d33b85343ca994fe2d93b226bee => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:12.950620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:12.951069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:13.002199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:13.004870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:13.119222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 853/1729] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:11:13.143553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:13.145105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:13.211313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:13.253708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99eb4a-1b37-4e2d-b900-803ecc95125d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:13.262255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:13.262894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:13.263172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:13.263604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:13.282904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:13.284941 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:13.304898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 877/1730] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:14.089426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:14.091766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:14.111049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97b48c-db1c-4b88-b0ef-3ceb1259dac4 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:14.121319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:14.123942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:14.124663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:14.125096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] PATH_INFO: `/v3/projects/dd2b97f38f644715b5717b728fab090e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:14.137014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2b97f38f644715b5717b728fab090e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:14.140337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:14.253817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2b97f38f644715b5717b728fab090e', 'request_id': 'req-aea26a57-0688-49a6-adea-3f4382fb2553'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.268381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2b97f38f644715b5717b728fab090e', 'request_id': 'req-aea26a57-0688-49a6-adea-3f4382fb2553'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.292363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2b97f38f644715b5717b728fab090e', 'request_id': 'req-aea26a57-0688-49a6-adea-3f4382fb2553'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.312654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] The token cache is being invalidate because project dd2b97f38f644715b5717b728fab090e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:14.313095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.314003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.318614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 854/1731] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:14 2022] DELETE /identity/v3/projects/dd2b97f38f644715b5717b728fab090e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:14.320436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:14.332424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2677bc-7e20-42cf-90f0-1a6bf0120a5a service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:14.506628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:14.507911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:14.508455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:14.509437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] PATH_INFO: `/v3/users/6998897bac194102b0d5a4362c658abe` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:14.512981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6998897bac194102b0d5a4362c658abe)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:14.516408 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:14.627088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6998897bac194102b0d5a4362c658abe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.628063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6998897bac194102b0d5a4362c658abe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.657493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6998897bac194102b0d5a4362c658abe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.671055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6998897bac194102b0d5a4362c658abe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.672063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f2ebe540-04f6-4851-98b2-8e53c14bb0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6998897bac194102b0d5a4362c658abe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:14.697141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 878/1732] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:14 2022] DELETE /identity/v3/users/6998897bac194102b0d5a4362c658abe => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:15.371302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:15.373808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:15.392739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea26a57-0688-49a6-adea-3f4382fb2553 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:15.460262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:15.528069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:15.530275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:15.530570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:15.530848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] PATH_INFO: `/v3/projects/9bff0f0bcc91495ba03c28716eb42646` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:15.532070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bff0f0bcc91495ba03c28716eb42646)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:15.534964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:15.599546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:15.600609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:15.601387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:15.626794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bff0f0bcc91495ba03c28716eb42646', 'request_id': 'req-5cda6393-f07e-47c3-aa7b-6ee4374149ac'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.633560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] MFA Rules not processed for user `9286b1b118e84552bc6118d15c92972a`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:15.634814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bff0f0bcc91495ba03c28716eb42646', 'request_id': 'req-5cda6393-f07e-47c3-aa7b-6ee4374149ac'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.635821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:15.644687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bff0f0bcc91495ba03c28716eb42646', 'request_id': 'req-5cda6393-f07e-47c3-aa7b-6ee4374149ac'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.661349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] The token cache is being invalidate because project 9bff0f0bcc91495ba03c28716eb42646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:15.661646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.662315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.668839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 855/1733] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:15 2022] DELETE /identity/v3/projects/9bff0f0bcc91495ba03c28716eb42646 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:15.670943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:15.672890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:15.697323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:15.721697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 879/1734] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:15.726107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:15.727611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:15.753508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6393-f07e-47c3-aa7b-6ee4374149ac admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:15.759252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:15.760682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:15.761262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:15.761545 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] PATH_INFO: `/v3/users/505e1ac479c94e44b147313fe4d73e14` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:15.762785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505e1ac479c94e44b147313fe4d73e14)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:15.764791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:15.804480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cb71d-15ab-45bd-80c5-fb184edba279 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:15.810381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:15.811000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:15.811289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:15.811606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:15.812247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:15.814155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:15.823605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505e1ac479c94e44b147313fe4d73e14'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.830732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505e1ac479c94e44b147313fe4d73e14'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.838203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:15.842737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 880/1735] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:15.843970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505e1ac479c94e44b147313fe4d73e14'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.846514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505e1ac479c94e44b147313fe4d73e14'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.847016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:15.848595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:15.855871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505e1ac479c94e44b147313fe4d73e14'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:15.862590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 856/1736] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:15 2022] DELETE /identity/v3/users/505e1ac479c94e44b147313fe4d73e14 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:15.919034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612da0-55e4-4259-b2fc-f0eb05d3e8b5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:15.988434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:15.989769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:15.990062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:15.990538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:15.991782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:15.994591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.026660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 881/1737] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:15 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:16.027930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.043331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cc3a8-dca8-442a-a069-9486a266c103 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.054183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.054855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.055216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.055660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.056913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.058651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.070243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 857/1738] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:16.074539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.085585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aab2b-72d1-42d0-bef9-d6a1eb328a29 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.090469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.091253 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.091673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.092156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] PATH_INFO: `/v3/projects/4f548028fefb4ff09cf6292c23b78c04/users/7acd5b772072486f97101d82a0d391d8/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.103305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:16.115116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f548028fefb4ff09cf6292c23b78c04, user_id=7acd5b772072486f97101d82a0d391d8, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.120198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.146172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 882/1739] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:16 2022] PUT /identity/v3/projects/4f548028fefb4ff09cf6292c23b78c04/users/7acd5b772072486f97101d82a0d391d8/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:16.147085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.160319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ad68-4fe7-4955-9162-2e74adb45f01 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.169499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.171908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:16.241650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.242385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.243339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.243668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.244378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.246371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.260749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 858/1740] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:16.264619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.275436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1dce-e81b-43f0-9982-3a8d78c3fd15 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.280553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e192-f1c4-4d7e-abf4-acbfcc4f7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.281206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e192-f1c4-4d7e-abf4-acbfcc4f7573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.281485 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e192-f1c4-4d7e-abf4-acbfcc4f7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.281757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e192-f1c4-4d7e-abf4-acbfcc4f7573 admin admin] PATH_INFO: `/v3/projects/4f548028fefb4ff09cf6292c23b78c04/users/7acd5b772072486f97101d82a0d391d8/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.283778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e192-f1c4-4d7e-abf4-acbfcc4f7573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f548028fefb4ff09cf6292c23b78c04, user_id=7acd5b772072486f97101d82a0d391d8, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.286438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e192-f1c4-4d7e-abf4-acbfcc4f7573 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.291535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752589-6884-4d30-badd-05dab9c6edd5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.299109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 859/1741] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:16 2022] PUT /identity/v3/projects/4f548028fefb4ff09cf6292c23b78c04/users/7acd5b772072486f97101d82a0d391d8/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:16.363925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.364572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.364848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.365120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] PATH_INFO: `/v3/projects/3baa91067eb443a6b637614dc3f6c08b` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.366258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3baa91067eb443a6b637614dc3f6c08b)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.368248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.430275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3baa91067eb443a6b637614dc3f6c08b', 'request_id': 'req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:16.441236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3baa91067eb443a6b637614dc3f6c08b', 'request_id': 'req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:16.453610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3baa91067eb443a6b637614dc3f6c08b', 'request_id': 'req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:16.467113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] The token cache is being invalidate because project 3baa91067eb443a6b637614dc3f6c08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:16.467430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:16.468195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1e6ac4b3-ed1a-4334-8316-3c2b0dd1d674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:16.469767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 883/1742] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:16 2022] DELETE /identity/v3/projects/3baa91067eb443a6b637614dc3f6c08b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:16.474643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.475619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.476137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.503834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:16.505043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:16.612805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 860/1743] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:16.614647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.615075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.615231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.648237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:16.649581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:16.663065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 884/1744] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:16.668336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.679831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81192a-9570-4576-a578-eb33716f5b40 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.686267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.686954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.687283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.687733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.688388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:16.688688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.690517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.725613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 861/1745] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:11:16.741152 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.753452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a813-5f44-4c73-b577-4895f2f9f198 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.759666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.760305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.760589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.760912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.761566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.763581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.780987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:16.802661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 885/1746] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:16 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:16.804296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.820539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41c75f-6aa8-494a-88f2-061b2512d158 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.878396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:16.904079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.904910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.905216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.906057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.907356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.909560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.933886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 862/1747] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:16 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:16.939134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.952663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e62d-bf69-4ea0-b65e-2587481eacd8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.958745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.959737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.960073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.960569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:16.961322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:16.963135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:16.975582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 886/1748] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:16.979912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:16.992041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b4c6-619c-4391-8d29-0a46c6f2c851 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:16.998504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372dead-0f29-4636-a7f7-4b401119444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:16.999134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372dead-0f29-4636-a7f7-4b401119444f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:16.999442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372dead-0f29-4636-a7f7-4b401119444f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:16.999724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372dead-0f29-4636-a7f7-4b401119444f admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.000381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372dead-0f29-4636-a7f7-4b401119444f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.003097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372dead-0f29-4636-a7f7-4b401119444f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.019033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 863/1749] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:17.020730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.031896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f1c1a-5e43-4073-8662-008d0884a844 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.036825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.037509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.037869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.038149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] PATH_INFO: `/v3/projects/25fadcd919964611a85914c3424823aa/users/f609b8455767464ba1064ee37055c75a/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.055495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fadcd919964611a85914c3424823aa, user_id=f609b8455767464ba1064ee37055c75a, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.058220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.074416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 887/1750] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:17 2022] PUT /identity/v3/projects/25fadcd919964611a85914c3424823aa/users/f609b8455767464ba1064ee37055c75a/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:17.085193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.085484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.085772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.121146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] MFA Rules not processed for user `f609b8455767464ba1064ee37055c75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:17.122767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:17.222984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 864/1751] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:17.227716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.332590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dc291-4008-4a4a-9000-30e357b7220e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.351478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.357711 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.358771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.359199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.360924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.365370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.428984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 888/1752] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:17 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:17.433954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.460149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c388-25c2-43fc-ab10-ea2c0a25bdc0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.539177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.542723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.542979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.543315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.544403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.546913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.581934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 865/1753] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:17 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:17.585514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.598351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b517-5dc8-4547-b528-927916aff203 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.604148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.604820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.605239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.606008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.606797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.608844 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.624520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 889/1754] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:17.626990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.638830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f979b6-e3d7-42b6-8f3e-b97ddd6dd070 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.645230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059aedc-d3ed-4155-bee0-d356eee25f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.646409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059aedc-d3ed-4155-bee0-d356eee25f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.647113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059aedc-d3ed-4155-bee0-d356eee25f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.647893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059aedc-d3ed-4155-bee0-d356eee25f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.648873 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059aedc-d3ed-4155-bee0-d356eee25f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.651315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059aedc-d3ed-4155-bee0-d356eee25f09 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.670234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.676042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 866/1755] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:17.682642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba788-80ce-4dcd-8874-711bbd07f546 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.688093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.688992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.689545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.690014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] PATH_INFO: `/v3/projects/e7e1bcc5a8514dcdb4f759d5c07c0d91/users/b5b5950278b440c8aa736a5c15de7ec7/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.709986 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1bcc5a8514dcdb4f759d5c07c0d91, user_id=b5b5950278b440c8aa736a5c15de7ec7, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.714182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.749940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.750231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.750513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.754055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 890/1756] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:17 2022] PUT /identity/v3/projects/e7e1bcc5a8514dcdb4f759d5c07c0d91/users/b5b5950278b440c8aa736a5c15de7ec7/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:17.790576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.798642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:17.811773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] MFA Rules not processed for user `b5b5950278b440c8aa736a5c15de7ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:17.813135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:17.841178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:17.909147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6734f-a269-480f-83d0-d0e85e55254a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.918694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 867/1757] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:17.920926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.921581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.921860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.922275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] PATH_INFO: `/v3/users/959fb2f9fb3e47cf9fd7ac649738011f` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.923823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:17.924940 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959fb2f9fb3e47cf9fd7ac649738011f)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.927942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.942291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:17.945423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25175541-37cc-4eb5-aaf1-3fc7a491d88f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:17.957201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:17.959230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:17.959354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:17.959687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:17.960684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:17.965528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:17.998789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959fb2f9fb3e47cf9fd7ac649738011f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:18.000046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959fb2f9fb3e47cf9fd7ac649738011f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:18.003021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 868/1758] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:18.007586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.010713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:18.016534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959fb2f9fb3e47cf9fd7ac649738011f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:18.028789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959fb2f9fb3e47cf9fd7ac649738011f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:18.029954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9d965daa-ed66-4989-8e66-14b453179bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959fb2f9fb3e47cf9fd7ac649738011f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:18.055214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 891/1759] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:17 2022] DELETE /identity/v3/users/959fb2f9fb3e47cf9fd7ac649738011f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:18.060987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.061933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.062405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.098073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec1ad-464c-437d-9837-299f21bd5d3b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:18.099949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:18.102690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:18.171278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:18.172946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.173703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.174130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.176231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:18.180271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:18.197405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 892/1760] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:18.212044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 869/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:18 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:18.213908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.215658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.216647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:18.228118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f76ccd-929b-44dd-9816-f0b1b8461169 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:18.234926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:18.235580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.235862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.236209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.237118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:18.239576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:18.257599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 870/1762] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:18.263927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.284983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ae99-a37a-4ea7-a6c4-9da17039241c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:18.310399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eaf3d-06ae-4995-9ee9-4c0a255c2ea8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:18.311543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:18.312512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.312651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.312871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] PATH_INFO: `/v3/projects/5f3334648beb4935a8715227eff5e94e/users/b86051ecdc2742f4a03d8f9adc514ac9/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.314642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:18.315316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.315753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.316041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.328254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:18.329709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:18.342672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 893/1763] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:18.357632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3334648beb4935a8715227eff5e94e, user_id=b86051ecdc2742f4a03d8f9adc514ac9, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:18.360368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:18.387430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:18.396128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 871/1764] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:18 2022] PUT /identity/v3/projects/5f3334648beb4935a8715227eff5e94e/users/b86051ecdc2742f4a03d8f9adc514ac9/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:18.401297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.411432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01bbfc-83ff-4e72-9ea9-8106e1f3e7c2 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:18.501251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:18.563020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c3c0-eced-40c5-9679-29fb2440803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:18.564077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c3c0-eced-40c5-9679-29fb2440803c admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.564933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c3c0-eced-40c5-9679-29fb2440803c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.565384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c3c0-eced-40c5-9679-29fb2440803c admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.567452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c3c0-eced-40c5-9679-29fb2440803c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:18.572381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c3c0-eced-40c5-9679-29fb2440803c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:18.611624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 894/1765] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:18.612790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.627764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ed5e-1b77-4d29-ac63-b870e58e8e36 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:18.637724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:18.638473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.640500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.640802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] PATH_INFO: `/v3/projects/5f3334648beb4935a8715227eff5e94e/users/b86051ecdc2742f4a03d8f9adc514ac9/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.646789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3334648beb4935a8715227eff5e94e, user_id=b86051ecdc2742f4a03d8f9adc514ac9, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:18.649579 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:18.688553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 872/1766] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:18 2022] PUT /identity/v3/projects/5f3334648beb4935a8715227eff5e94e/users/b86051ecdc2742f4a03d8f9adc514ac9/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:18.702203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527180-2a08-44a3-8448-fda656087093 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:18.702709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527180-2a08-44a3-8448-fda656087093 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:18.702709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527180-2a08-44a3-8448-fda656087093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:18.800736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-15527180-2a08-44a3-8448-fda656087093 None None] MFA Rules not processed for user `b86051ecdc2742f4a03d8f9adc514ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:18.803945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-15527180-2a08-44a3-8448-fda656087093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:18.936228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 895/1767] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:18.943869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:18.945590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:18.999920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15527180-2a08-44a3-8448-fda656087093 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:19.001869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-15527180-2a08-44a3-8448-fda656087093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:19.093939 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c30fa5-d725-48a3-8e22-ea1d0b8fdc17 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:19.098041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:19.098666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:19.098945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:19.099214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:19.102392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:19.147231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15527180-2a08-44a3-8448-fda656087093 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:19.160798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:19.161834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:19.161834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:19.163058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] PATH_INFO: `/v3/projects/d09df39e51fe468dab8c88e0db9e655c` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:19.164441 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09df39e51fe468dab8c88e0db9e655c)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:19.166969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:19.220313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:19.222981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:19.237597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 873/1768] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:19.250868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09df39e51fe468dab8c88e0db9e655c', 'request_id': 'req-de0315b1-2e40-4f41-acad-9a83c80970f8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.262372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09df39e51fe468dab8c88e0db9e655c', 'request_id': 'req-de0315b1-2e40-4f41-acad-9a83c80970f8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.266932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:19.277125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09df39e51fe468dab8c88e0db9e655c', 'request_id': 'req-de0315b1-2e40-4f41-acad-9a83c80970f8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.302544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] The token cache is being invalidate because project d09df39e51fe468dab8c88e0db9e655c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:19.302887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.304107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.308834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 896/1769] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:18 2022] DELETE /identity/v3/projects/d09df39e51fe468dab8c88e0db9e655c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:19.312456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:19.326855 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b7d41-b29c-41f0-81a2-f1d297ea4317 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:19.423717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:19.424765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:19.425408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:19.426037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] PATH_INFO: `/v3/users/e9352f86b6824a4bbcacab7502b62566` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:19.427600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9352f86b6824a4bbcacab7502b62566)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:19.430403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:19.501606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:19.515674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9352f86b6824a4bbcacab7502b62566'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.527635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9352f86b6824a4bbcacab7502b62566'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.551205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9352f86b6824a4bbcacab7502b62566'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.552403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9352f86b6824a4bbcacab7502b62566'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.574990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1b065b73-a5af-457f-95c6-d0dae8953bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9352f86b6824a4bbcacab7502b62566'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:19.590892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 874/1770] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:19 2022] DELETE /identity/v3/users/e9352f86b6824a4bbcacab7502b62566 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:20.061061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:20.063435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:20.093450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0315b1-2e40-4f41-acad-9a83c80970f8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:20.194709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:20.195376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:20.195682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:20.195959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] PATH_INFO: `/v3/projects/8051cf647f304350a835216a9f2f8472` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:20.197852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8051cf647f304350a835216a9f2f8472)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:20.204149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:20.359742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8051cf647f304350a835216a9f2f8472', 'request_id': 'req-f78fb8a8-4d27-435c-bba2-222a0fb35e53'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:20.376249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8051cf647f304350a835216a9f2f8472', 'request_id': 'req-f78fb8a8-4d27-435c-bba2-222a0fb35e53'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:20.416499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8051cf647f304350a835216a9f2f8472', 'request_id': 'req-f78fb8a8-4d27-435c-bba2-222a0fb35e53'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:20.437389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] The token cache is being invalidate because project 8051cf647f304350a835216a9f2f8472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:20.438061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:20.438378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f78fb8a8-4d27-435c-bba2-222a0fb35e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:20.446928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 897/1771] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:20 2022] DELETE /identity/v3/projects/8051cf647f304350a835216a9f2f8472 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:20.447103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:20.447548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:20.447857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:20.498903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:20.506114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:20.655826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 875/1772] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:20.664876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:20.665635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:20.667472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:20.729406 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:20.731130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:20.762088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 898/1773] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:20.766358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:20.781430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac197f1-631e-4cc5-b1e0-bf73700b679d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:20.796144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:20.797598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:20.798059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:20.798476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:20.799477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:20.799929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:20.803426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:20.818921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 876/1774] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:11:20.823025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:20.832785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5cb47-4cbb-4750-b241-a8f6c1cd0cb2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:20.841366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:20.842150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:20.842562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:20.842925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:20.844200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:20.847578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:20.975360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 899/1775] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:20 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:20.980059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:21.004374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea2f2-af5b-416e-ba03-cde102aa0872 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:21.228250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:21.228887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.229170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.229439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.230088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:21.232519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:21.298511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 877/1776] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:20 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:11:21.299782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:21.318537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a1baa-2be8-4064-933f-07c68159cbde admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:21.343221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:21.344201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.344201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.344427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.345118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:21.353507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:21.365878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:21.367607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:21.384385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 900/1777] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:21.386057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:21.401745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8f31-6480-4cc6-b5fe-d25a3c5abc03 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:21.410684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:21.411974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.412365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.415074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.415973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:21.418610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:21.440507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 901/1778] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:21.441786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:21.457388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6603bb-7721-406d-b7c4-3bcb3b78e371 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:21.464975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc590d-5a80-4df4-b4f6-9dc39f60f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:21.465974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc590d-5a80-4df4-b4f6-9dc39f60f908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.467175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc590d-5a80-4df4-b4f6-9dc39f60f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.467922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc590d-5a80-4df4-b4f6-9dc39f60f908 admin admin] PATH_INFO: `/v3/projects/3a28348ef0f443e9a6c09ad3df9ef0df/users/d6fbf04f9b9341f9ab082bb90b24fcfd/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.471440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:21.508471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc590d-5a80-4df4-b4f6-9dc39f60f908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a28348ef0f443e9a6c09ad3df9ef0df, user_id=d6fbf04f9b9341f9ab082bb90b24fcfd, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:21.512443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc590d-5a80-4df4-b4f6-9dc39f60f908 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:21.513488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9062b-dbc5-4d04-b00c-ab89532dce5c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:21.528380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:21.529007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.529295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.529569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.531997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:21.533797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:21.538511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 902/1779] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:21 2022] PUT /identity/v3/projects/3a28348ef0f443e9a6c09ad3df9ef0df/users/d6fbf04f9b9341f9ab082bb90b24fcfd/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:21.550407 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.550860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.551313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.618826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] MFA Rules not processed for user `d6fbf04f9b9341f9ab082bb90b24fcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:21.620472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:21.704093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:21.708554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:21.730129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 878/1780] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:21.761175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 903/1781] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:21.765898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:21.787744 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0fdd0-4ad1-4c81-bce0-9b93393855bd service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:21.942484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:21.948666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:21.949102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:21.949726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:21.950512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:21.952698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:22.019387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 879/1782] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:21 2022] POST /identity/v3/projects => generated 393 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:22.023213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:22.064557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121f80f-5abb-4660-9ac6-11a563fe9764 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:22.236384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:22.238618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:22.238902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:22.239176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:22.241318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:22.248748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:22.307685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 904/1783] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:22 2022] POST /identity/v3/users => generated 303 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:22.310107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:22.329162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0a1b-ec62-4fac-99aa-8a2158faac77 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:22.339465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:22.344051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:22.345858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:22.346353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:22.348619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:22.354214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:22.387024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 880/1784] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:22.391652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:22.414294 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8625-b893-4836-87f4-94159ca072d1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:22.436337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:22.442322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:22.444150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:22.444150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] PATH_INFO: `/v3/projects/14e8bf6603a149f1833123890f4a33af/users/d7b9892c979948d9af39998025df4b32/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:22.464465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e8bf6603a149f1833123890f4a33af, user_id=d7b9892c979948d9af39998025df4b32, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:22.470733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:22.521451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 905/1785] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:22 2022] PUT /identity/v3/projects/14e8bf6603a149f1833123890f4a33af/users/d7b9892c979948d9af39998025df4b32/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:22.523491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:22.545420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663fb33-c610-4c53-9a58-e9e6076c5355 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:22.731957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f586a15-bd02-4a21-8372-dc0f49b6485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:22.736306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f586a15-bd02-4a21-8372-dc0f49b6485a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:22.736778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f586a15-bd02-4a21-8372-dc0f49b6485a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:22.737207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f586a15-bd02-4a21-8372-dc0f49b6485a admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:22.741256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f586a15-bd02-4a21-8372-dc0f49b6485a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:22.747869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f586a15-bd02-4a21-8372-dc0f49b6485a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:22.767760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:22.777262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 881/1786] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:22.784500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:22.821527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7d845-3fbd-4efc-af8e-815ba4077d3d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:22.856761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:22.857628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:22.858193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:22.858601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] PATH_INFO: `/v3/projects/14e8bf6603a149f1833123890f4a33af/users/d7b9892c979948d9af39998025df4b32/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:22.864302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e8bf6603a149f1833123890f4a33af, user_id=d7b9892c979948d9af39998025df4b32, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:22.867375 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:22.908197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 906/1787] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:22 2022] PUT /identity/v3/projects/14e8bf6603a149f1833123890f4a33af/users/d7b9892c979948d9af39998025df4b32/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:22.920366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:22.920759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:22.921138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:22.981869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:22.993932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] MFA Rules not processed for user `d7b9892c979948d9af39998025df4b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:22.995212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:23.118244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:23.144022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c680e-8c7b-4fec-874e-452bfc19881f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:23.150776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:23.151560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:23.151795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:23.152067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:23.158403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:23.218292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 882/1788] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:23.232224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:23.236286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:23.279950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cba037-adff-4527-acb5-3f80e892ebd4 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:23.290325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:23.291171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:23.291493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:23.291779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:23.292608 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:23.292716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f2dd-ddba-46c1-9ca2-028f08d8cb77 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:23.307175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:23.308841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:23.325203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 883/1789] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:23.366984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 907/1790] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:11:23.487234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:23.510912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8b1c7-28dd-44f3-a674-cbe4c5238d06 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:23.524227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:23.547895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:23.548551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:23.549052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:23.762102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:23.762102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:23.787618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 884/1791] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:24.423834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83025-e3bb-4ca4-b4c0-28473de5a3ba None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:24.424768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83025-e3bb-4ca4-b4c0-28473de5a3ba None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:24.425232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83025-e3bb-4ca4-b4c0-28473de5a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:24.466047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-30d83025-e3bb-4ca4-b4c0-28473de5a3ba None None] MFA Rules not processed for user `7acd5b772072486f97101d82a0d391d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:24.467303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-30d83025-e3bb-4ca4-b4c0-28473de5a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:24.555326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 908/1792] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:24.568871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:24.570819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:24.670499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2b38b-ca72-400c-b3e1-8049a7083212 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:24.675717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:24.676680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:24.677304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:24.678994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:24.680267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:24.687040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:24.799082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:24.803962 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:24.837111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 885/1793] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:25.115275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:25.115797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:25.116079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:25.188128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:25.192092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:25.325698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 909/1794] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:25.344419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:25.345890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:25.564270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe5116-54bf-4a85-b1d5-a68b20932aae service glance] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:25.577104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248ce3-50f5-4a15-a10f-ac63ad897ba0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:25.578339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248ce3-50f5-4a15-a10f-ac63ad897ba0 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:25.579020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248ce3-50f5-4a15-a10f-ac63ad897ba0 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:25.579813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248ce3-50f5-4a15-a10f-ac63ad897ba0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:25.595817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb248ce3-50f5-4a15-a10f-ac63ad897ba0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:25.628286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb248ce3-50f5-4a15-a10f-ac63ad897ba0 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:25.654143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 886/1795] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:28.269937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:28.271683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:28.327211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:28.445148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef43f-a68c-4505-a483-f81c5d10e3b1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:28.450706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:28.451555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:28.451746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:28.452141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] PATH_INFO: `/v3/users/f609b8455767464ba1064ee37055c75a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:28.453402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f609b8455767464ba1064ee37055c75a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:28.455567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:28.563336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f609b8455767464ba1064ee37055c75a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:28.564292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f609b8455767464ba1064ee37055c75a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:28.583973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f609b8455767464ba1064ee37055c75a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:28.597423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f609b8455767464ba1064ee37055c75a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:28.598856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-eabf6d30-5bc3-4876-9cc5-d7691f61fe54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f609b8455767464ba1064ee37055c75a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:28.627548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 910/1796] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:28 2022] DELETE /identity/v3/users/f609b8455767464ba1064ee37055c75a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:28.632229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:28.633111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:28.633546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:28.686009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:28.687645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:28.754569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9075-f693-4416-9eae-c8927713a750 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:28.754866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9075-f693-4416-9eae-c8927713a750 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:28.755143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9075-f693-4416-9eae-c8927713a750 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:28.757903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 911/1797] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:11:28.794293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:28.794589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:28.794864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:28.812295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 887/1798] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:28.824549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:28.826051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:28.842230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55a509-672a-4bfa-97fb-1a83b8fb07a5 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:28.848137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:28.855477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:28.856175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:28.856947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] PATH_INFO: `/v3/users/d6fbf04f9b9341f9ab082bb90b24fcfd` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:28.858520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fbf04f9b9341f9ab082bb90b24fcfd)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:28.863338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:28.874306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:28.875574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:28.981999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:29.034989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fbf04f9b9341f9ab082bb90b24fcfd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.044632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 912/1799] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:11:29.045514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:29.049674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.066761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fbf04f9b9341f9ab082bb90b24fcfd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.118124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fbf04f9b9341f9ab082bb90b24fcfd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.121112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fbf04f9b9341f9ab082bb90b24fcfd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.150372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fbf04f9b9341f9ab082bb90b24fcfd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.157114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:29.168479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 888/1800] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:28 2022] DELETE /identity/v3/users/d6fbf04f9b9341f9ab082bb90b24fcfd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:29.174273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:29.182534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.206565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd575c-4625-4a0b-adae-b3bbbf278a26 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:29.322304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:29.323183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:29.323621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:29.324279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:29.327471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.403840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81731-056c-461a-b0be-88981f9270d5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:29.417885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:29.418839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:29.419143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:29.419497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] PATH_INFO: `/v3/users/539c711ce9ef45179be5a9aa893bb7ee` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:29.420907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=539c711ce9ef45179be5a9aa893bb7ee)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:29.427127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:29.519707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:29.532745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4027-a7f8-46ba-8921-5dd87fd5dbbe service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:29.535052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539c711ce9ef45179be5a9aa893bb7ee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.549090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539c711ce9ef45179be5a9aa893bb7ee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.567652 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 913/1801] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:29.569082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:29.569376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:29.569643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:29.570387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539c711ce9ef45179be5a9aa893bb7ee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.572755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539c711ce9ef45179be5a9aa893bb7ee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.593600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539c711ce9ef45179be5a9aa893bb7ee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:29.603736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 889/1802] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:29 2022] DELETE /identity/v3/users/539c711ce9ef45179be5a9aa893bb7ee => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:29.651747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:29.652999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.687911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:29.690461 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.771328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:29.808370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 914/1803] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:29.859957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:29.861725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.884622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a25f0-ad1e-4c5b-964d-46d7eb0bed5e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:29.891895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:29.892624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:29.892974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:29.893316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:29.897795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:29.912168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:29.913977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:29.934875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 890/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:29.943025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:29.971766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c48b-9c86-4f53-ae7e-f5c45b3199ab None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:29.980325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:29.980962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:29.981239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:29.981923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:30.004872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:30.006637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:30.018338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 915/1805] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:30.416479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:30.418169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:30.474312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502cd46-f30f-4619-8e5c-9f483ea2fe29 service placement] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:30.489450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:30.492056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:30.495888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:30.496220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] PATH_INFO: `/v3/projects/3a28348ef0f443e9a6c09ad3df9ef0df` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:30.502262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a28348ef0f443e9a6c09ad3df9ef0df)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:30.510371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:30.614647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a28348ef0f443e9a6c09ad3df9ef0df', 'request_id': 'req-ec534517-2cc4-48b5-9210-8a5a2d2496a0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:30.624725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a28348ef0f443e9a6c09ad3df9ef0df', 'request_id': 'req-ec534517-2cc4-48b5-9210-8a5a2d2496a0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:30.682614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a28348ef0f443e9a6c09ad3df9ef0df', 'request_id': 'req-ec534517-2cc4-48b5-9210-8a5a2d2496a0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:30.715256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:30.717221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:30.720819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] The token cache is being invalidate because project 3a28348ef0f443e9a6c09ad3df9ef0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:30.722955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:30.725238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:30.729429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 891/1806] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:30 2022] DELETE /identity/v3/projects/3a28348ef0f443e9a6c09ad3df9ef0df => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:30.733672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:30.738105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e4a6b-63d8-4715-aaf4-e6ac1fae5cc1 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:30.740779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:30.924539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:30.925495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:30.926020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:30.926502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] PATH_INFO: `/v3/projects/25fadcd919964611a85914c3424823aa` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:30.929245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fadcd919964611a85914c3424823aa)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:30.945572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:30.953377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec534517-2cc4-48b5-9210-8a5a2d2496a0 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:30.964872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:30.966052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:30.966343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:30.966620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] PATH_INFO: `/v3/users/d7b9892c979948d9af39998025df4b32` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:30.971380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b9892c979948d9af39998025df4b32)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:30.975131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:31.049734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fadcd919964611a85914c3424823aa', 'request_id': 'req-7f90c49a-6505-4f65-af42-f555a2a9f3f7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.066279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fadcd919964611a85914c3424823aa', 'request_id': 'req-7f90c49a-6505-4f65-af42-f555a2a9f3f7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.087869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fadcd919964611a85914c3424823aa', 'request_id': 'req-7f90c49a-6505-4f65-af42-f555a2a9f3f7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.089241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:31.100377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b9892c979948d9af39998025df4b32'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.110821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] The token cache is being invalidate because project 25fadcd919964611a85914c3424823aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:31.124050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.125108 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b9892c979948d9af39998025df4b32'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.125586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.131649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 916/1807] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:30 2022] DELETE /identity/v3/projects/25fadcd919964611a85914c3424823aa => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:31.132511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:31.134218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:31.158920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b9892c979948d9af39998025df4b32'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.159927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b9892c979948d9af39998025df4b32'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.172695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b9892c979948d9af39998025df4b32'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.187513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 892/1808] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:30 2022] DELETE /identity/v3/users/d7b9892c979948d9af39998025df4b32 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:31.188926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:31.190825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:31.289069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c49a-6505-4f65-af42-f555a2a9f3f7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:31.327084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670352a-1313-45a6-8c81-67ca0006bb5d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:31.341975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:31.342734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:31.343087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:31.343528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] PATH_INFO: `/v3/users/b5b5950278b440c8aa736a5c15de7ec7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:31.344997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:31.346136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b5950278b440c8aa736a5c15de7ec7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:31.351731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:31.483149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b5950278b440c8aa736a5c15de7ec7'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.492371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:31.496013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:31.496582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:31.497122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] PATH_INFO: `/v3/projects/1cc13b8d594740dba5e0fa92b91a6bd2` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:31.502708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc13b8d594740dba5e0fa92b91a6bd2)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:31.505733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:31.511791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b5950278b440c8aa736a5c15de7ec7'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.554490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b5950278b440c8aa736a5c15de7ec7'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.555268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b5950278b440c8aa736a5c15de7ec7'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.566673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3f0265b3-e451-4f48-9480-532338498034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b5950278b440c8aa736a5c15de7ec7'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.579438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 893/1809] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:31 2022] DELETE /identity/v3/users/b5b5950278b440c8aa736a5c15de7ec7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:31.647736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc13b8d594740dba5e0fa92b91a6bd2', 'request_id': 'req-11082d0d-7100-48f9-a796-e346794a19e0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.676133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc13b8d594740dba5e0fa92b91a6bd2', 'request_id': 'req-11082d0d-7100-48f9-a796-e346794a19e0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.690262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc13b8d594740dba5e0fa92b91a6bd2', 'request_id': 'req-11082d0d-7100-48f9-a796-e346794a19e0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.710527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] The token cache is being invalidate because project 1cc13b8d594740dba5e0fa92b91a6bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:31.710879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.712194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:31.714316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 917/1810] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:31 2022] DELETE /identity/v3/projects/1cc13b8d594740dba5e0fa92b91a6bd2 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:31.719455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c280-f782-4e10-9c67-6ab2e784a2ce None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:31.719750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c280-f782-4e10-9c67-6ab2e784a2ce None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:31.720030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c280-f782-4e10-9c67-6ab2e784a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:31.776669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0a72c280-f782-4e10-9c67-6ab2e784a2ce None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:31.777934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0a72c280-f782-4e10-9c67-6ab2e784a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:31.834984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:31.852820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:31.860803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:31.873775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 894/1811] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:31.881571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:31.881951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:31.883313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:31.896718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11082d0d-7100-48f9-a796-e346794a19e0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:31.918680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:31.919344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:31.919849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:31.921197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] PATH_INFO: `/v3/projects/14e8bf6603a149f1833123890f4a33af` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:31.924139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e8bf6603a149f1833123890f4a33af)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:31.926083 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:31.969062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:31.970410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:31.996956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 895/1812] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:32.004523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.014179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503063-ab9e-4135-825c-6f194150b6eb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.051863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e8bf6603a149f1833123890f4a33af', 'request_id': 'req-f702b629-e6af-4b44-8bd4-b286da0f1e11'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.066465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e8bf6603a149f1833123890f4a33af', 'request_id': 'req-f702b629-e6af-4b44-8bd4-b286da0f1e11'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.083533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e8bf6603a149f1833123890f4a33af', 'request_id': 'req-f702b629-e6af-4b44-8bd4-b286da0f1e11'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.100529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.105210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.106061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] The token cache is being invalidate because project 14e8bf6603a149f1833123890f4a33af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:32.106363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.106638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.107905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.108021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.108895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:32.109305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.109867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 918/1813] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:31 2022] DELETE /identity/v3/projects/14e8bf6603a149f1833123890f4a33af => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:32.114996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3371455-ec94-4382-b8bf-3f4dc5cb8b1e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.117939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.120257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.134283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 896/1814] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:11:32.135579 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.135898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.136147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.142527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702b629-e6af-4b44-8bd4-b286da0f1e11 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.148298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.149066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.149505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.150917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] PATH_INFO: `/v3/projects/e7e1bcc5a8514dcdb4f759d5c07c0d91` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.152127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e1bcc5a8514dcdb4f759d5c07c0d91)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.156958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.212236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:32.214085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.235147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:32.237649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 897/1815] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:32.238500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.242048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.267979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b287-2043-4cad-bb73-d19a50965c63 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.269645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e1bcc5a8514dcdb4f759d5c07c0d91', 'request_id': 'req-d3df777a-9c28-4c42-882b-76af7f45d677'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.280751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e1bcc5a8514dcdb4f759d5c07c0d91', 'request_id': 'req-d3df777a-9c28-4c42-882b-76af7f45d677'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.296552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e1bcc5a8514dcdb4f759d5c07c0d91', 'request_id': 'req-d3df777a-9c28-4c42-882b-76af7f45d677'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.314070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] The token cache is being invalidate because project e7e1bcc5a8514dcdb4f759d5c07c0d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:32.314536 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.315321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d3df777a-9c28-4c42-882b-76af7f45d677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.321747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 919/1816] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:32 2022] DELETE /identity/v3/projects/e7e1bcc5a8514dcdb4f759d5c07c0d91 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:32.323162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.323533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.323886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.380883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:32.382556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.439747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.440529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.440874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.441226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.441975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.451377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.512002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 898/1817] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:32 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:32.512002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.512896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.535017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 920/1818] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:32.539249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.540673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.571490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a36d-747c-469e-9635-247a42be94e3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.594110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:32.616266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de908-ffc0-4c2a-8f7f-a98dbf10f4b7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.621631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.622261 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.622539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.622810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] PATH_INFO: `/v3/users/b86051ecdc2742f4a03d8f9adc514ac9` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.624000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86051ecdc2742f4a03d8f9adc514ac9)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.625928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.637998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.638818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.639118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.639458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.640212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.642235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.673235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 921/1819] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:32 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:32.674237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.694692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496c0e5-631b-420d-9ea9-c1f02b0e4f9b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.703490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86051ecdc2742f4a03d8f9adc514ac9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.704031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.704828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.705107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.705444 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.706396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:32.706700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.708622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.711033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86051ecdc2742f4a03d8f9adc514ac9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.724241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86051ecdc2742f4a03d8f9adc514ac9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.725007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86051ecdc2742f4a03d8f9adc514ac9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.728186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 922/1820] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:11:32.731573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.734158 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.736226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86051ecdc2742f4a03d8f9adc514ac9'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:32.745314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 899/1821] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:32 2022] DELETE /identity/v3/users/b86051ecdc2742f4a03d8f9adc514ac9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:32.746793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.748450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:32.749904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d89fd-6c6a-4094-a003-e710eaacb7e3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.804894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:32.848884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.849561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.849843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.850115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.851050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.852741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.871985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 923/1822] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:32.874333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.892680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1fcc2-dd51-4cf4-ac18-6a28f9c61005 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.894017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8949-1c9c-412b-bebf-efd735a01697 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:32.899089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.899748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.900283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.900638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.901288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.903675 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.910721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:32.911608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:32.912452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:32.913125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:32.914358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:32.916728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:32.933934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 924/1823] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:32.935134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.949300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 900/1824] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:32 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:32.956305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:32.957944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725836f7-9a76-41be-8c6d-0f8c3baaa5b3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.059549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe9e5-410b-4a49-9fe5-016ca0927b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.062977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe9e5-410b-4a49-9fe5-016ca0927b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.064078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe9e5-410b-4a49-9fe5-016ca0927b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.064835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe9e5-410b-4a49-9fe5-016ca0927b4e admin admin] PATH_INFO: `/v3/projects/4b0a0ce59f2d43eba7fd57aa2b4245de/users/0b9ef1203b0b4af39dd66b252eace4d0/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.084984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:33.098714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe9e5-410b-4a49-9fe5-016ca0927b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a0ce59f2d43eba7fd57aa2b4245de, user_id=0b9ef1203b0b4af39dd66b252eace4d0, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.104387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe9e5-410b-4a49-9fe5-016ca0927b4e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.130695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 925/1825] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:32 2022] PUT /identity/v3/projects/4b0a0ce59f2d43eba7fd57aa2b4245de/users/0b9ef1203b0b4af39dd66b252eace4d0/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:33.135767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.136289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.136638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.140195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbb82-16b9-4c54-9701-a9d7f26d6043 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.170481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:33.171853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.257376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.258170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.258452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.261160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.261160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.263557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.291286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 926/1826] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:33.291286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.298345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.315478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 901/1827] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:32 2022] POST /identity/v3/users => generated 286 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:33.316631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.319282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.323184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c442f-c2c8-4310-a29c-16a7a813e718 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.328935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.329575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.329975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.330249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] PATH_INFO: `/v3/projects/5f3334648beb4935a8715227eff5e94e` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.331612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3334648beb4935a8715227eff5e94e)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.333663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.396275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4bd77-b9ff-4ec7-8894-da9335f1e757 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.405048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:33.428259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3334648beb4935a8715227eff5e94e', 'request_id': 'req-ba2e4676-d783-4847-b297-080bd1a0cafe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:33.443661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3334648beb4935a8715227eff5e94e', 'request_id': 'req-ba2e4676-d783-4847-b297-080bd1a0cafe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:33.460398 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3334648beb4935a8715227eff5e94e', 'request_id': 'req-ba2e4676-d783-4847-b297-080bd1a0cafe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:33.481410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] The token cache is being invalidate because project 5f3334648beb4935a8715227eff5e94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:33.481708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:33.482754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:33.483135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.484344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 927/1828] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:33 2022] DELETE /identity/v3/projects/5f3334648beb4935a8715227eff5e94e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:33.485190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.487285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.489126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.489464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.489726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.492120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.574303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4676-d783-4847-b297-080bd1a0cafe admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.580385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fc854-bc4e-4a24-a2fe-c42bcce9c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.581019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc854-bc4e-4a24-a2fe-c42bcce9c27b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.581295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc854-bc4e-4a24-a2fe-c42bcce9c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.581564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc854-bc4e-4a24-a2fe-c42bcce9c27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.582215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fc854-bc4e-4a24-a2fe-c42bcce9c27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.584561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fc854-bc4e-4a24-a2fe-c42bcce9c27b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.602737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 928/1829] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:33.604382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2446-0af3-447d-aa40-4382783151bb None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.604719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2446-0af3-447d-aa40-4382783151bb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.605000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2446-0af3-447d-aa40-4382783151bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.621639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:33.639102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-bc3a2446-0af3-447d-aa40-4382783151bb None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:33.643752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-bc3a2446-0af3-447d-aa40-4382783151bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.649635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.653013 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e41aa-6a1b-4985-a0b7-25af74961928 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.669133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 902/1830] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:33.692467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.693274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.695305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.745319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:33.746546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.768851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 903/1831] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:33.769782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.782111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18735f-9847-4cef-9ca5-e7edf54c31a8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.784451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 929/1832] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:33.787839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.790359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.793962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.794101 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.794662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.794944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.795221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.795899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.797496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.820344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 904/1833] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:33.820344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.827375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.842558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:33.846507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:33.860659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 930/1834] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:33.862376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.879725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5d41b-58cf-4c2d-87b9-fa883c65a4d3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:33.891442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:33.893555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:33.893555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:33.893555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] PATH_INFO: `/v3/projects/ac473642c95447be9418a868e0c0b36b/users/66a9f61294f84d1594afcdf3bbf9f0d1/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:33.924594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac473642c95447be9418a868e0c0b36b, user_id=66a9f61294f84d1594afcdf3bbf9f0d1, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:33.928780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:33.956789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 931/1835] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:33 2022] PUT /identity/v3/projects/ac473642c95447be9418a868e0c0b36b/users/66a9f61294f84d1594afcdf3bbf9f0d1/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:33.958463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:33.976724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990b112-5d61-4b12-b91d-e42bb3a2b98d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.031016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:34.066029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511962d-da45-43c1-ae04-b359aed9e173 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.072723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.073605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.073946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.074231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.074909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:11:34.075269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.077960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0a7d-6e57-464e-b08f-7ae577d6d637 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.092057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.092915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.093313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.094293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.102443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 932/1836] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:11:34.104141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.104430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.104704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.130075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:34.131549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:34.143743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 933/1837] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:34.143743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:34.165220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42bad5-908d-4aeb-9b6b-acc0011102c1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.173563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.174241 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.174524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.174797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.175893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.177581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.223374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.225754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.232459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 934/1838] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:34 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:34.233628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:34.235335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:34.243074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 905/1839] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:34.245886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:34.269923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7e6b9-88b7-4873-8dbd-ffcd3b5476a1 service swift] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.291152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:34.357698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8badee5-d4a5-472a-90df-4ddf35f7066a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.370663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7072f-be95-45db-84bc-922952960cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.372916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7072f-be95-45db-84bc-922952960cef service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.373064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7072f-be95-45db-84bc-922952960cef service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.373254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7072f-be95-45db-84bc-922952960cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.388841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.389519 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.389896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.390275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.391081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.393369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.433263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 906/1840] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:34 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:34.439356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:34.455724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57238bf6-be78-452c-b93b-37a92e64345a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.464038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.464776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.465214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.465544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.466340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.468272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.481792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 907/1841] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:34.485503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:34.501218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06163c-f056-449e-8894-f1f68a48dfca admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.507770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.508728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.509257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.510337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.511244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.512709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7072f-be95-45db-84bc-922952960cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.513476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.514171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7072f-be95-45db-84bc-922952960cef service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.526945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 908/1842] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:34.532657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:34.542496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 935/1843] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:34.550236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254d339-41ab-4e7e-a11d-4da3bac2706d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:34.557032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:34.557803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.558180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.559133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] PATH_INFO: `/v3/projects/519c7403aa6f4fd2893cf8bb7a92f41d/users/9d51a72b03764004ad006859ca4aff62/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.589506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519c7403aa6f4fd2893cf8bb7a92f41d, user_id=9d51a72b03764004ad006859ca4aff62, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:34.602456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:34.632769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 909/1844] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:34 2022] PUT /identity/v3/projects/519c7403aa6f4fd2893cf8bb7a92f41d/users/9d51a72b03764004ad006859ca4aff62/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:11:34.633817 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c348-dbf4-4b38-bfd8-3c1264d6d5dc None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:34.634625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c348-dbf4-4b38-bfd8-3c1264d6d5dc None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:34.634625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c348-dbf4-4b38-bfd8-3c1264d6d5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:34.676661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7370c348-dbf4-4b38-bfd8-3c1264d6d5dc None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:34.678221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7370c348-dbf4-4b38-bfd8-3c1264d6d5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:34.798530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:34.816583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 936/1845] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:34.856704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:35.003758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a80-b6e5-4e23-ab0d-bf0aad16a634 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:35.007759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:35.008372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:35.008709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:35.008990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:35.022093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:35.023930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:35.039997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 910/1846] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:35.610917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c199d6-3b3b-4190-b225-e6771303ee1d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:35.612008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c199d6-3b3b-4190-b225-e6771303ee1d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:35.612468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c199d6-3b3b-4190-b225-e6771303ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:35.635131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b1c199d6-3b3b-4190-b225-e6771303ee1d None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:35.637074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b1c199d6-3b3b-4190-b225-e6771303ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:35.772011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 937/1847] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:35.796038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:35.935724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c3d27-4d33-4d50-ae35-90a494355540 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:35.943316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36245374-3668-4a5f-ba92-8166176581c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:35.944102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36245374-3668-4a5f-ba92-8166176581c0 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:35.945072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36245374-3668-4a5f-ba92-8166176581c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:35.945495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36245374-3668-4a5f-ba92-8166176581c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:35.953471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:35.963318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36245374-3668-4a5f-ba92-8166176581c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:35.965970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36245374-3668-4a5f-ba92-8166176581c0 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:35.984642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 911/1848] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:36.378066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63345c2e-70f6-407d-8842-62806f9b924b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:36.378359 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63345c2e-70f6-407d-8842-62806f9b924b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:36.378641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63345c2e-70f6-407d-8842-62806f9b924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:36.435266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:36.435785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:36.437428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:36.486978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-63345c2e-70f6-407d-8842-62806f9b924b None None] MFA Rules not processed for user `66a9f61294f84d1594afcdf3bbf9f0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:36.488242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-63345c2e-70f6-407d-8842-62806f9b924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:36.593123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] MFA Rules not processed for user `9d51a72b03764004ad006859ca4aff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:36.594573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:36.767246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 938/1849] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:36.768743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:36.769037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:36.769321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:36.842852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:36.845141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:36.859027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 939/1850] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:36.862542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:36.889600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56daa90-52cf-4f9e-bbcb-94bcf2384659 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:36.898257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:36.899166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:36.899631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:36.900085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:36.901438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:36.904760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:36.921400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 912/1851] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:36.922739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:36.947686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ffdf6-45f6-4773-bc20-1da18eeb2eff None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:36.975010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:36.975010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:36.975010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:36.975010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:36.983275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 940/1852] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:11:36 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:36.983275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:36.990472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:36.991265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:36.993081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.025047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 913/1853] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:37.026893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:37.074637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ade1f-c4e4-41cf-8378-4a216df18e2c service swift] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:37.110649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d829c-cf26-4dec-ac65-f76ee5aee054 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:37.123291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:37.128946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.129493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.130723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.175798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:37.230163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:37.230797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.231080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.231351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.232622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:37.234605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.305049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:37.307803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 914/1854] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:11:37 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:11:37.308570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.311358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:37.338333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 941/1855] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:37.347174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57710d-6975-41e6-9808-6cb8bb3c68a9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:37.369951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:37.373932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.374453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.374876 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.384450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:37.386889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.421325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 915/1856] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:11:37.422465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:37.438575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d194647-8205-4fa6-9fa0-7c107fd57d1b service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:37.450049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7b27b-53c0-4284-9508-228a45dd75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:37.450898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b27b-53c0-4284-9508-228a45dd75e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.457344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b27b-53c0-4284-9508-228a45dd75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.457914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b27b-53c0-4284-9508-228a45dd75e7 admin admin] PATH_INFO: `/v3/projects/a48179caeb934e6bbf7106d98a9c9c55/users/a9cb143193f04c99bb3c1125446d76fd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.491612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b27b-53c0-4284-9508-228a45dd75e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48179caeb934e6bbf7106d98a9c9c55, user_id=a9cb143193f04c99bb3c1125446d76fd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:37.495201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b27b-53c0-4284-9508-228a45dd75e7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.528777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 942/1857] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:37 2022] PUT /identity/v3/projects/a48179caeb934e6bbf7106d98a9c9c55/users/a9cb143193f04c99bb3c1125446d76fd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:37.532527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:37.546172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2904b-e7a5-4b49-af57-6f354097b8e5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:37.704790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:37.719937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96d2f-a5ef-49dc-ab0e-b06f394d0de6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.720907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96d2f-a5ef-49dc-ab0e-b06f394d0de6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.723770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96d2f-a5ef-49dc-ab0e-b06f394d0de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.751713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:37.752502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.755610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.762018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.762933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:37.764740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.781615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 916/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:11:37.785389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:37.786320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-38b96d2f-a5ef-49dc-ab0e-b06f394d0de6 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:37.787601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-38b96d2f-a5ef-49dc-ab0e-b06f394d0de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:37.821664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddf19-b4f8-43b6-8a93-d308786d0d75 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:37.844176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:37.844864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:37.845148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:37.845430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] PATH_INFO: `/v3/projects/a48179caeb934e6bbf7106d98a9c9c55/users/a9cb143193f04c99bb3c1125446d76fd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:37.854800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48179caeb934e6bbf7106d98a9c9c55, user_id=a9cb143193f04c99bb3c1125446d76fd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:37.857865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:37.890764 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 917/1859] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:11:37 2022] PUT /identity/v3/projects/a48179caeb934e6bbf7106d98a9c9c55/users/a9cb143193f04c99bb3c1125446d76fd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:37.953349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 943/1860] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 13:11:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:37.975135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:38.163796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26709a2-e5a9-4fbb-95f0-917ec201e231 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:38.178846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379c028-4aa0-4ffa-b736-277762dadecf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:38.180478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379c028-4aa0-4ffa-b736-277762dadecf service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:38.182845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379c028-4aa0-4ffa-b736-277762dadecf service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:38.183526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379c028-4aa0-4ffa-b736-277762dadecf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:38.265090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379c028-4aa0-4ffa-b736-277762dadecf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:38.267074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379c028-4aa0-4ffa-b736-277762dadecf service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:38.278671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 918/1861] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:11:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 13:11:39.208120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e604-c7f1-4415-8bb5-d68d98978b9c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:39.209638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e604-c7f1-4415-8bb5-d68d98978b9c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:39.210073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e604-c7f1-4415-8bb5-d68d98978b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:39.243328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-c7a6e604-c7f1-4415-8bb5-d68d98978b9c None None] MFA Rules not processed for user `9d51a72b03764004ad006859ca4aff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:39.246138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c7a6e604-c7f1-4415-8bb5-d68d98978b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:39.387993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 944/1862] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:40.616749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:40.617322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:40.617322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:40.678059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] MFA Rules not processed for user `a9cb143193f04c99bb3c1125446d76fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:40.679717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:40.776684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:40.797116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:40.797988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:40.798424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:40.804151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 919/1863] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:40.834821 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] MFA Rules not processed for user `66a9f61294f84d1594afcdf3bbf9f0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:40.836796 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:40.895569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:40.924697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 945/1864] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:40.936028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:40.937756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:41.059112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3c84-d264-47d5-8562-7a96a458d435 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:41.065667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417776e-936b-4abc-b030-a3d1d61e7bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:41.066298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417776e-936b-4abc-b030-a3d1d61e7bfa service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:41.066579 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417776e-936b-4abc-b030-a3d1d61e7bfa service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:41.066887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417776e-936b-4abc-b030-a3d1d61e7bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:41.079199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417776e-936b-4abc-b030-a3d1d61e7bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:41.081087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417776e-936b-4abc-b030-a3d1d61e7bfa service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:41.093404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 920/1865] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:41.201044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:41.203484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:41.389672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9eb05-4f81-49df-8655-2b3b21120ce5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:41.405234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:41.405949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:41.406187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:41.406466 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] PATH_INFO: `/v3/users/5896122596e94c839695b9356e7dcb63` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:41.415801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5896122596e94c839695b9356e7dcb63)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:41.418419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:41.591888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5896122596e94c839695b9356e7dcb63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:41.592600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5896122596e94c839695b9356e7dcb63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:41.627426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5896122596e94c839695b9356e7dcb63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:41.645344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5896122596e94c839695b9356e7dcb63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:41.647173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5896122596e94c839695b9356e7dcb63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:41.686460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:41.686943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:41.687044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:41.694636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 946/1866] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:11:41 2022] DELETE /identity/v3/users/5896122596e94c839695b9356e7dcb63 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:41.739919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:41.743093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:41.888997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 921/1867] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:41.945000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:41.947061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:42.146034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5397658-4ea0-4da7-a4f2-275bad0535ae admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:42.156427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3654b-ec41-46e0-86b8-cc03d22dbdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:42.157269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3654b-ec41-46e0-86b8-cc03d22dbdce service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:42.157681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3654b-ec41-46e0-86b8-cc03d22dbdce service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:42.158056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3654b-ec41-46e0-86b8-cc03d22dbdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:42.172889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3654b-ec41-46e0-86b8-cc03d22dbdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:42.172889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3654b-ec41-46e0-86b8-cc03d22dbdce service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:42.187851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 947/1868] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:43.552396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:43.557846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:43.573928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f887e-a814-46a9-ba03-01ad2758c2bf None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:43.587314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:43.588106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:43.589126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:43.589415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] PATH_INFO: `/v3/projects/7e35f4771401496887597f950b4d497b` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:43.590701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e35f4771401496887597f950b4d497b)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:43.592678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:43.689581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e35f4771401496887597f950b4d497b', 'request_id': 'req-25654ea8-cfd1-4faa-9845-2e2bb4779367'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:43.701723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e35f4771401496887597f950b4d497b', 'request_id': 'req-25654ea8-cfd1-4faa-9845-2e2bb4779367'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:43.735343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e35f4771401496887597f950b4d497b', 'request_id': 'req-25654ea8-cfd1-4faa-9845-2e2bb4779367'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:43.754956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] The token cache is being invalidate because project 7e35f4771401496887597f950b4d497b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:11:43.755327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:43.755930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:11:43.767474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 922/1869] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:11:43 2022] DELETE /identity/v3/projects/7e35f4771401496887597f950b4d497b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:11:44.242998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d38d2-e843-4bcc-ade5-503ac49ef6aa None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:44.244162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d38d2-e843-4bcc-ade5-503ac49ef6aa None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:44.244326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d38d2-e843-4bcc-ade5-503ac49ef6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:44.278553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:44.292041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-8a8d38d2-e843-4bcc-ade5-503ac49ef6aa None None] MFA Rules not processed for user `0b9ef1203b0b4af39dd66b252eace4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:44.295555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8a8d38d2-e843-4bcc-ade5-503ac49ef6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:44.421099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 948/1870] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:44.435340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:44.436771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:44.467245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:44.647625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654ea8-cfd1-4faa-9845-2e2bb4779367 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:44.653952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0b8f-aafc-4af4-a363-04d71ab4e5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:44.654681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0b8f-aafc-4af4-a363-04d71ab4e5de service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:44.655008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0b8f-aafc-4af4-a363-04d71ab4e5de service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:44.655251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0b8f-aafc-4af4-a363-04d71ab4e5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:44.682353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0b8f-aafc-4af4-a363-04d71ab4e5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:44.684529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0b8f-aafc-4af4-a363-04d71ab4e5de service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:44.709651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 923/1871] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:11:45.890032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123252bb-65b5-4b33-a181-fb669aa6d0d1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:45.891056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123252bb-65b5-4b33-a181-fb669aa6d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:45.891559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123252bb-65b5-4b33-a181-fb669aa6d0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:45.913364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-123252bb-65b5-4b33-a181-fb669aa6d0d1 None None] MFA Rules not processed for user `9286b1b118e84552bc6118d15c92972a`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:45.914633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-123252bb-65b5-4b33-a181-fb669aa6d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:45.998612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 949/1872] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:47.388043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:47.388522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:47.388630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:47.417341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] MFA Rules not processed for user `0b9ef1203b0b4af39dd66b252eace4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:47.420388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:47.443932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 924/1873] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:52.009151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:52.009634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:52.009715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:52.050312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:11:52.051735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:52.154701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 950/1874] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:11:52.167772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:11:52.169207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:11:52.257048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136be9-6d88-4888-918d-8484e8dc407d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:11:52.265620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d6e1-c0da-46c0-a4b6-3b73ac4f7c41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:11:52.266376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d6e1-c0da-46c0-a4b6-3b73ac4f7c41 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:11:52.266760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d6e1-c0da-46c0-a4b6-3b73ac4f7c41 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:11:52.267157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d6e1-c0da-46c0-a4b6-3b73ac4f7c41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:11:52.280444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49d6e1-c0da-46c0-a4b6-3b73ac4f7c41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:11:52.282678 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49d6e1-c0da-46c0-a4b6-3b73ac4f7c41 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:11:52.295928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 925/1875] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:12:02.145924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=78 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:02.290259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=66 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:20.590865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:20.592433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:20.672602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012831fe-f277-442c-902b-8ef81f519d6d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:20.677768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:20.678422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:20.678697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:20.678967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:20.681022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:20.749649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:20.751116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:20.761590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 951/1876] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:12:21.249896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7fb9-18fb-4318-b543-210abdec6c2b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:21.250459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7fb9-18fb-4318-b543-210abdec6c2b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:21.250459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7fb9-18fb-4318-b543-210abdec6c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:21.273377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-118a7fb9-18fb-4318-b543-210abdec6c2b None None] MFA Rules not processed for user `9d51a72b03764004ad006859ca4aff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:21.275100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-118a7fb9-18fb-4318-b543-210abdec6c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:21.346066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 926/1877] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:12:30.756754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=50 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:31.339594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=25 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:31.671491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:31.673551 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:31.735988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442ff1-52b1-4ce1-8274-99a27637d06a service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:31.739836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:31.740446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:31.740724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:31.740994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:31.742748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:31.805482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:31.806950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f59a03-9b0f-494c-8180-f11234415533 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:31.817482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 952/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:12:38.073944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd031-ffb1-464d-9c8b-95bdd85a7494 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:38.074831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd031-ffb1-464d-9c8b-95bdd85a7494 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:38.075264 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd031-ffb1-464d-9c8b-95bdd85a7494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:38.101974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6b3cd031-ffb1-464d-9c8b-95bdd85a7494 None None] MFA Rules not processed for user `6f9396941e5548aebdd1cd5fb4dc9fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:38.103193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6b3cd031-ffb1-464d-9c8b-95bdd85a7494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:38.166740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 927/1879] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:12:41.812339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=50 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:47.633420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216473f6-1239-45c7-91e4-245c8f579e23 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:47.634073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216473f6-1239-45c7-91e4-245c8f579e23 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:47.634073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216473f6-1239-45c7-91e4-245c8f579e23 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:47.635480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 953/1880] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:12:47.643825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23712-460f-4d9f-9ca5-a69037c59288 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:47.645004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23712-460f-4d9f-9ca5-a69037c59288 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:47.645397 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23712-460f-4d9f-9ca5-a69037c59288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:47.666957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-91e23712-460f-4d9f-9ca5-a69037c59288 None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:47.668302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-91e23712-460f-4d9f-9ca5-a69037c59288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:47.738528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216473f6-1239-45c7-91e4-245c8f579e23 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:47.740709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-216473f6-1239-45c7-91e4-245c8f579e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:47.769327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 928/1881] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:12:47.781337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a566bfa-fc4d-4f09-8f53-280cbb9d42d8 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:47.781654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a566bfa-fc4d-4f09-8f53-280cbb9d42d8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:47.781932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a566bfa-fc4d-4f09-8f53-280cbb9d42d8 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:47.784044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 929/1882] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 13:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:12:47.788386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:47.788797 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:47.788917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:47.808488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] MFA Rules not processed for user `c8c2cffed4c54b0ea5cbde5b7d3f5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:47.809697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:47.819210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 930/1883] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:12:47.820831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216473f6-1239-45c7-91e4-245c8f579e23 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:47.825411 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:47.825978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:47.826250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:47.826518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] PATH_INFO: `/v3/users/66a9f61294f84d1594afcdf3bbf9f0d1` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:47.826633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:47.827671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a9f61294f84d1594afcdf3bbf9f0d1)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:47.830257 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:47.837282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481bc7-ae07-418e-8eeb-637de49b5e39 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:47.842597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:47.843192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:47.843505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:47.843779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:47.852590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:47.853827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:47.864291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 931/1884] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:12:47.878834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a9f61294f84d1594afcdf3bbf9f0d1'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:47.879525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a9f61294f84d1594afcdf3bbf9f0d1'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:47.893355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a9f61294f84d1594afcdf3bbf9f0d1'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:47.900754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a9f61294f84d1594afcdf3bbf9f0d1'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:47.901518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a9f61294f84d1594afcdf3bbf9f0d1'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:47.913710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 954/1885] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:12:47 2022] DELETE /identity/v3/users/66a9f61294f84d1594afcdf3bbf9f0d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:12:48.081438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:48.092981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80543a04-aad8-4909-9e9e-81fa9dba6b15 service placement] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:48.153993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:48.154559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:48.154834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:48.155123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] PATH_INFO: `/v3/projects/ac473642c95447be9418a868e0c0b36b` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:48.156248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac473642c95447be9418a868e0c0b36b)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:48.158184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:48.186569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:48.210925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac473642c95447be9418a868e0c0b36b', 'request_id': 'req-1541e357-5487-462c-8594-9bda472f18dc'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.217042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac473642c95447be9418a868e0c0b36b', 'request_id': 'req-1541e357-5487-462c-8594-9bda472f18dc'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.225086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac473642c95447be9418a868e0c0b36b', 'request_id': 'req-1541e357-5487-462c-8594-9bda472f18dc'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.237992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] The token cache is being invalidate because project ac473642c95447be9418a868e0c0b36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:12:48.238280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.238955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.240694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 932/1886] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:12:48 2022] DELETE /identity/v3/projects/ac473642c95447be9418a868e0c0b36b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:12:48.244598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:48.246042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:48.262030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503d70-4ead-45ed-8be0-3163ca9b2f28 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:48.327974 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:48.328732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:48.329794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:48.330137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] PATH_INFO: `/v3/users/a9cb143193f04c99bb3c1125446d76fd` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:48.331628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cb143193f04c99bb3c1125446d76fd)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:48.333725 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:48.356674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:48.387463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cb143193f04c99bb3c1125446d76fd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.388273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cb143193f04c99bb3c1125446d76fd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.400741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cb143193f04c99bb3c1125446d76fd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.408402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cb143193f04c99bb3c1125446d76fd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.409143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d5ac9bee-2e19-49a5-8b8a-9e267c3cdaec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cb143193f04c99bb3c1125446d76fd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.426138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 955/1887] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:12:48 2022] DELETE /identity/v3/users/a9cb143193f04c99bb3c1125446d76fd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:12:48.600614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:48.602040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:48.615536 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541e357-5487-462c-8594-9bda472f18dc admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:48.674634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:48.675275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:48.675695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:48.675994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] PATH_INFO: `/v3/projects/a48179caeb934e6bbf7106d98a9c9c55` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:48.677105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48179caeb934e6bbf7106d98a9c9c55)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:48.679016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:48.733621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48179caeb934e6bbf7106d98a9c9c55', 'request_id': 'req-26a75767-3c72-4399-8681-8e9d66c3c5b5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.742557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48179caeb934e6bbf7106d98a9c9c55', 'request_id': 'req-26a75767-3c72-4399-8681-8e9d66c3c5b5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.752907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48179caeb934e6bbf7106d98a9c9c55', 'request_id': 'req-26a75767-3c72-4399-8681-8e9d66c3c5b5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.766331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] The token cache is being invalidate because project a48179caeb934e6bbf7106d98a9c9c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:12:48.766331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.766331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-26a75767-3c72-4399-8681-8e9d66c3c5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:48.771228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 933/1888] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:12:48 2022] DELETE /identity/v3/projects/a48179caeb934e6bbf7106d98a9c9c55 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:12:48.773091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:48.773553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:48.773763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:48.801097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:48.803075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:48.890385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 956/1889] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:12:48.897867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:48.898155 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:48.898432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:48.927918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:48.930314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:48.941674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 934/1890] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:12:48.945576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:48.957089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9119b-e9fb-4893-bb94-fd89c10f2752 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:48.965279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:48.965909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:48.966665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:48.966982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:48.968692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:12:48.969015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:48.970692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:48.986127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 957/1891] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:12:48.995634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:49.009415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b7c0a-6ea1-4976-a22f-214fdd23773f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:49.014599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:49.015476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.015761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.016035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.016704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:49.018616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:49.049711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 935/1892] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:12:49.050595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:49.060981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac655d2-8376-43a3-87e9-e85bd3258238 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:49.132910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:49.133521 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.133801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.134076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.134760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:49.136751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:49.160140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 958/1893] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:12:49 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:12:49.164443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:49.175129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871cfca-0e2c-4c8e-b361-7cec5fb609c8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:49.180258 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:49.180868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.181201 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.181481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.182157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:49.183972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:49.195029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 936/1894] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:12:49.199078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:49.210360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a87f6-02b0-4646-8a8b-8df053c8486b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:49.215965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d907f10-e657-4624-b318-9cb1fa0c7045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:49.216685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907f10-e657-4624-b318-9cb1fa0c7045 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.217069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907f10-e657-4624-b318-9cb1fa0c7045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.217440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907f10-e657-4624-b318-9cb1fa0c7045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.218183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d907f10-e657-4624-b318-9cb1fa0c7045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:49.219947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d907f10-e657-4624-b318-9cb1fa0c7045 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:49.231409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 959/1895] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:12:49.236133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:49.242629 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:49.254802 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f156-bd17-4216-adf6-9fdb45302e1e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:49.261053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:49.261710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.261992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.262571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] PATH_INFO: `/v3/projects/5b3b0d8fa28b458e8334e784e0f9b426/users/3331ba60e25f429e81fc111bcb68245f/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.279048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3b0d8fa28b458e8334e784e0f9b426, user_id=3331ba60e25f429e81fc111bcb68245f, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:49.281799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:49.298338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 937/1896] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:12:49 2022] PUT /identity/v3/projects/5b3b0d8fa28b458e8334e784e0f9b426/users/3331ba60e25f429e81fc111bcb68245f/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:12:49.312442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.312922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.313340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.322570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:49.353036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] MFA Rules not processed for user `3331ba60e25f429e81fc111bcb68245f`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:49.355694 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:49.455610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:49.456209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 960/1897] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:12:49.458208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:49.556888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cac60-675d-4726-b143-98d1c3ba488e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:49.560750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde731c-4aca-48f7-a9d5-724d10824776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:49.561463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde731c-4aca-48f7-a9d5-724d10824776 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:49.561759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde731c-4aca-48f7-a9d5-724d10824776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:49.562029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde731c-4aca-48f7-a9d5-724d10824776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:49.571378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde731c-4aca-48f7-a9d5-724d10824776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:49.572835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde731c-4aca-48f7-a9d5-724d10824776 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:49.582870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 938/1898] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:12:52.188187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:52.258845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92415-50fe-447a-aec8-725e6c5265ad None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:52.263514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:52.264381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:52.264760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:52.265045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] PATH_INFO: `/v3/users/3331ba60e25f429e81fc111bcb68245f` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:52.266472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3331ba60e25f429e81fc111bcb68245f)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:52.268978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:52.296566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:52.297128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:52.297265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:52.318210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:52.319481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:52.320095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3331ba60e25f429e81fc111bcb68245f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:52.320768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3331ba60e25f429e81fc111bcb68245f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:52.332808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3331ba60e25f429e81fc111bcb68245f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:52.340429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3331ba60e25f429e81fc111bcb68245f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:52.341217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-81661ae6-160f-4737-a5b3-959f60b37f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3331ba60e25f429e81fc111bcb68245f'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:52.354511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 961/1899] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:12:52 2022] DELETE /identity/v3/users/3331ba60e25f429e81fc111bcb68245f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:12:52.358751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:52.359036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:52.359312 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:52.378879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:52.380133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:52.382000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 939/1900] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:12:52.388935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:52.429547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:52.431926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:52.448897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 962/1901] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:12:52.458897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:52.460331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:52.515741 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636252bd-b4af-42be-9b2f-752cadeb5e40 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:52.528847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef367-becb-4c4b-ab32-36ba5025a9f2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:52.533204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:52.533818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:52.534092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:52.534367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:52.545021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:52.545720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:52.549254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:52.566647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 963/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:12:52.584985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdf382-437d-42af-8e13-c11940ac88d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:52.585656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf382-437d-42af-8e13-c11940ac88d6 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:52.585936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf382-437d-42af-8e13-c11940ac88d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:52.586208 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf382-437d-42af-8e13-c11940ac88d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:52.647223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf382-437d-42af-8e13-c11940ac88d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:52.648857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf382-437d-42af-8e13-c11940ac88d6 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:52.659383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 940/1903] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:12:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 13:12:52.996788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.003843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:53.043327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9e90e-02cb-4b45-a61a-dbbd4b6d553a service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.048971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.049606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.049880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.050150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] PATH_INFO: `/v3/projects/5b3b0d8fa28b458e8334e784e0f9b426` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.051335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3b0d8fa28b458e8334e784e0f9b426)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.053280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.155911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3b0d8fa28b458e8334e784e0f9b426', 'request_id': 'req-13135c9f-c938-4341-bf1a-47480168d2cf'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:53.169043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3b0d8fa28b458e8334e784e0f9b426', 'request_id': 'req-13135c9f-c938-4341-bf1a-47480168d2cf'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:53.185170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3b0d8fa28b458e8334e784e0f9b426', 'request_id': 'req-13135c9f-c938-4341-bf1a-47480168d2cf'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:53.222144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] The token cache is being invalidate because project 5b3b0d8fa28b458e8334e784e0f9b426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:12:53.222738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:53.225935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13135c9f-c938-4341-bf1a-47480168d2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:12:53.227923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 964/1904] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:12:52 2022] DELETE /identity/v3/projects/5b3b0d8fa28b458e8334e784e0f9b426 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:12:53.233777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.234134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.234537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.259106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:53.260426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:53.328142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 941/1905] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:12:53.338040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.338375 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.338746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.360130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:53.361485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:53.372962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 965/1906] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:12:53.374583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.387337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea36b2-c214-4cbe-9f27-5940b15797d1 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.394752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.394752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.394752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.401651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.403520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:12:53.404205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.405861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.428725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 942/1907] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:12:53.433052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.443649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338588-fdc5-4615-acc6-ba35ca9a52e8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.449819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.450467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.450736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.451000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.451672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.453571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.497045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 966/1908] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:12:53 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:12:53.501604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.517538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810d478-0f80-4a87-949f-6db5a3c2a549 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.596148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:53.604290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.605000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.605370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.605719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.606427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.608496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.642540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 943/1909] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:12:53 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:12:53.643632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.658746 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db960-4f50-4b90-80b3-ac55ceee5ac4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.668133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.668759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.669824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.669824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.670001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.671564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.677396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:53.686097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 967/1910] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:12:53.687563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.699291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd27436-9de3-489c-b461-fcf8c0ee5d6d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.704023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafb64f-f12d-459f-8b31-9e90f7c66b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.705214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafb64f-f12d-459f-8b31-9e90f7c66b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.705495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafb64f-f12d-459f-8b31-9e90f7c66b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.705767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafb64f-f12d-459f-8b31-9e90f7c66b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.706478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafb64f-f12d-459f-8b31-9e90f7c66b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.711270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafb64f-f12d-459f-8b31-9e90f7c66b38 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.722671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 944/1911] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:12:53.727050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.742987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b11a-fba4-4753-b330-8de70f015b0b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:53.748914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:53.749600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.750349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.750349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] PATH_INFO: `/v3/projects/bad18e0465684dce9b5b6e9fbadfa186/users/168070fd3ee14538adbdc157b23a7c81/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.771647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad18e0465684dce9b5b6e9fbadfa186, user_id=168070fd3ee14538adbdc157b23a7c81, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:53.774334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:53.791831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 968/1912] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:12:53 2022] PUT /identity/v3/projects/bad18e0465684dce9b5b6e9fbadfa186/users/168070fd3ee14538adbdc157b23a7c81/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:12:53.800345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:53.800625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:53.800901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:53.837244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] MFA Rules not processed for user `168070fd3ee14538adbdc157b23a7c81`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:12:53.838615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:53.962069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 945/1913] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:12:53.977214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:12:53.979078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:12:54.045429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368a231-8fee-4ef5-97af-82b771d67885 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:12:54.049895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18eaff-4218-435f-a0e9-83a2b562390e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:12:54.050511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18eaff-4218-435f-a0e9-83a2b562390e service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:12:54.050789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18eaff-4218-435f-a0e9-83a2b562390e service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:12:54.051056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18eaff-4218-435f-a0e9-83a2b562390e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:12:54.060553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18eaff-4218-435f-a0e9-83a2b562390e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:12:54.062071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18eaff-4218-435f-a0e9-83a2b562390e service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:12:54.073585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 969/1914] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:03.464789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:03.466363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:03.577344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8d30-e518-48f0-8dda-4f4d31d4752c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:03.583146 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:03.584186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:03.584707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:03.585027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:03.586751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:03.600129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:03.601721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:03.613004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 946/1915] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:04.068074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:10.772069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7b9aa-31f1-4ead-8b09-c18503b3dfb7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:10.772686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7b9aa-31f1-4ead-8b09-c18503b3dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:10.772686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7b9aa-31f1-4ead-8b09-c18503b3dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:10.793008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e5c7b9aa-31f1-4ead-8b09-c18503b3dfb7 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:10.794219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e5c7b9aa-31f1-4ead-8b09-c18503b3dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:10.853062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 970/1916] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:10.866741 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:10.868329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:10.922954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:10.938817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0f443-336d-4c3f-8992-865f3ab1e01e service placement] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:10.944340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:10.944943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:10.945219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:10.945581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:10.953445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:10.955016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:10.963380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 947/1917] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:13:19.056575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:19.057162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:19.057263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:19.087065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:19.088524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:19.097062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 971/1918] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:19.113459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:19.125166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4bb0-2d4c-4da1-a055-945f0162f6b4 service swift] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:19.130628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:19.131377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:19.131785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:19.132178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:19.141611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:19.143499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:19.158473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 948/1919] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:13:21.652928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:21.654554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:21.721803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117172-101a-4c67-be07-6bc62ef204e5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:21.727251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:21.727952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:21.728236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:21.728520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] PATH_INFO: `/v3/users/9d51a72b03764004ad006859ca4aff62` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:21.729762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d51a72b03764004ad006859ca4aff62)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:21.731747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:21.781780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d51a72b03764004ad006859ca4aff62'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:21.782360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d51a72b03764004ad006859ca4aff62'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:21.794968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d51a72b03764004ad006859ca4aff62'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:21.804219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d51a72b03764004ad006859ca4aff62'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:21.804987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-55f37b78-e0ff-479c-9037-57d980d5bb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d51a72b03764004ad006859ca4aff62'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:21.817973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 972/1920] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:13:21 2022] DELETE /identity/v3/users/9d51a72b03764004ad006859ca4aff62 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:21.990888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:22.002149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe21226-028b-4f7a-b3df-f8fa1afe2b3e service swift] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:22.058745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:22.059303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:22.059615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:22.059892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] PATH_INFO: `/v3/projects/519c7403aa6f4fd2893cf8bb7a92f41d` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:22.061011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519c7403aa6f4fd2893cf8bb7a92f41d)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:22.062925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:22.116766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519c7403aa6f4fd2893cf8bb7a92f41d', 'request_id': 'req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:22.124360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519c7403aa6f4fd2893cf8bb7a92f41d', 'request_id': 'req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:22.134259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519c7403aa6f4fd2893cf8bb7a92f41d', 'request_id': 'req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:22.146500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] The token cache is being invalidate because project 519c7403aa6f4fd2893cf8bb7a92f41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:13:22.146894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:22.147665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c1eee6cc-c665-47cc-aa94-fd4ef69135e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:22.149497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 949/1921] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:13:21 2022] DELETE /identity/v3/projects/519c7403aa6f4fd2893cf8bb7a92f41d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:25.261719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660261-5dad-4397-80dc-44edd6d01167 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.262226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660261-5dad-4397-80dc-44edd6d01167 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.262333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660261-5dad-4397-80dc-44edd6d01167 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.263771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 973/1922] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 13:13:25.270068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ed3e-44da-4d48-abf0-d9f4c08c95c9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.270540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ed3e-44da-4d48-abf0-d9f4c08c95c9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.270765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ed3e-44da-4d48-abf0-d9f4c08c95c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.291129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6145ed3e-44da-4d48-abf0-d9f4c08c95c9 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:25.292396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6145ed3e-44da-4d48-abf0-d9f4c08c95c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:25.344966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:25.361899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 950/1923] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:25.374500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660261-5dad-4397-80dc-44edd6d01167 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:25.376216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-07660261-5dad-4397-80dc-44edd6d01167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:25.396565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:25.435425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660261-5dad-4397-80dc-44edd6d01167 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:25.438930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed444f8-0fde-4385-8ba6-c388a156b192 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:25.439570 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed444f8-0fde-4385-8ba6-c388a156b192 service glance] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.439847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed444f8-0fde-4385-8ba6-c388a156b192 service glance] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.440115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed444f8-0fde-4385-8ba6-c388a156b192 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.449948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed444f8-0fde-4385-8ba6-c388a156b192 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:25.451366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed444f8-0fde-4385-8ba6-c388a156b192 service glance] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:25.462458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 974/1924] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:25.531426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f829ef-7da9-4c80-9ad4-8e397ac387e5 None None] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.531736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f829ef-7da9-4c80-9ad4-8e397ac387e5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.532084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f829ef-7da9-4c80-9ad4-8e397ac387e5 None None] PATH_INFO: `/` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.533520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 951/1925] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:13:25.538791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6ec3-0507-4608-8dd6-2a58e0bd6fe2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.539079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6ec3-0507-4608-8dd6-2a58e0bd6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.539554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f6ec3-0507-4608-8dd6-2a58e0bd6fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.560049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6b6f6ec3-0507-4608-8dd6-2a58e0bd6fe2 None None] MFA Rules not processed for user `0fd9d9e53d0f4a2ca149de05ff08d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:25.561282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6b6f6ec3-0507-4608-8dd6-2a58e0bd6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:25.611118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 975/1926] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:25.623176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f829ef-7da9-4c80-9ad4-8e397ac387e5 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:25.625029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e3f829ef-7da9-4c80-9ad4-8e397ac387e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:25.638034 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f829ef-7da9-4c80-9ad4-8e397ac387e5 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:25.641537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0721f-c9a8-41e6-9323-951543ed244d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:25.642128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0721f-c9a8-41e6-9323-951543ed244d service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.642427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0721f-c9a8-41e6-9323-951543ed244d service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.642696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0721f-c9a8-41e6-9323-951543ed244d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.650017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0721f-c9a8-41e6-9323-951543ed244d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:25.651470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0721f-c9a8-41e6-9323-951543ed244d service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:25.659154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 952/1927] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:25.744879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541a89-7331-4a75-b642-998f583d4361 None None] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.745239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541a89-7331-4a75-b642-998f583d4361 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.745586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541a89-7331-4a75-b642-998f583d4361 None None] PATH_INFO: `/` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.747063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 976/1928] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 13:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 13:13:25.759640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4ee8-0999-4d52-a65a-f1da18f02ce0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.759640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4ee8-0999-4d52-a65a-f1da18f02ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.759640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4ee8-0999-4d52-a65a-f1da18f02ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.773453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-618d4ee8-0999-4d52-a65a-f1da18f02ce0 None None] MFA Rules not processed for user `74ff7e343a5e4aff9c4a52d1aa0332bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:25.774683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-618d4ee8-0999-4d52-a65a-f1da18f02ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:25.784012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 953/1929] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:25.794802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c541a89-7331-4a75-b642-998f583d4361 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:25.796507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5c541a89-7331-4a75-b642-998f583d4361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:25.809461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c541a89-7331-4a75-b642-998f583d4361 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:25.813031 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:25.813624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:25.813899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:25.814168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:25.823999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:25.825401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:25.836365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 977/1930] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:28.064501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:28.064982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:28.065086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:28.084883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:28.086075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:28.139188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 954/1931] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:28.151008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:28.152435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:28.223499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046fb6-f3ec-4d6a-bc14-28352be312f9 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:28.228544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d515b8c-dc3f-4d96-80fd-73e4c93e6d18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:28.229193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d515b8c-dc3f-4d96-80fd-73e4c93e6d18 service swift] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:28.229465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d515b8c-dc3f-4d96-80fd-73e4c93e6d18 service swift] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:28.229863 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d515b8c-dc3f-4d96-80fd-73e4c93e6d18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:28.239023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d515b8c-dc3f-4d96-80fd-73e4c93e6d18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:28.240913 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d515b8c-dc3f-4d96-80fd-73e4c93e6d18 service swift] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:28.249057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 978/1932] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:13:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:13:34.021841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:34.023254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:34.086808 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69afc-c755-4f8a-a00e-50ea91525389 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:34.091297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:34.091955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:34.092234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:34.092508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] PATH_INFO: `/v3/users/168070fd3ee14538adbdc157b23a7c81` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:34.093642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168070fd3ee14538adbdc157b23a7c81)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:34.095613 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:34.156499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168070fd3ee14538adbdc157b23a7c81'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.163685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168070fd3ee14538adbdc157b23a7c81'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.175716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168070fd3ee14538adbdc157b23a7c81'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.176474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168070fd3ee14538adbdc157b23a7c81'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.183818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168070fd3ee14538adbdc157b23a7c81'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.185243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:34.190850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 955/1933] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:13:34 2022] DELETE /identity/v3/users/168070fd3ee14538adbdc157b23a7c81 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:34.196010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:34.196531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:34.196648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:34.215927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:34.217164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:34.265631 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:34.284566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 979/1934] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:34.294254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:34.295716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:34.351541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948e6c2-00d1-4d7f-b05e-825e2a7dfa33 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:34.356037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be96f1-607a-4ae1-866a-a16a049b195b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:34.356953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be96f1-607a-4ae1-866a-a16a049b195b service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:34.357271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be96f1-607a-4ae1-866a-a16a049b195b service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:34.357663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be96f1-607a-4ae1-866a-a16a049b195b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:34.367990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be96f1-607a-4ae1-866a-a16a049b195b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:34.369480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be96f1-607a-4ae1-866a-a16a049b195b service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:34.393052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 956/1935] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:34.683138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:34.685121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:34.698858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4ad53-078c-4987-b075-4b32b1e67239 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:34.705075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:34.705719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:34.705997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:34.706271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] PATH_INFO: `/v3/projects/bad18e0465684dce9b5b6e9fbadfa186` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:34.707450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad18e0465684dce9b5b6e9fbadfa186)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:34.709425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:34.786655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad18e0465684dce9b5b6e9fbadfa186', 'request_id': 'req-91d77077-c40f-4820-acec-99edd81f2640'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.794775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad18e0465684dce9b5b6e9fbadfa186', 'request_id': 'req-91d77077-c40f-4820-acec-99edd81f2640'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.814012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad18e0465684dce9b5b6e9fbadfa186', 'request_id': 'req-91d77077-c40f-4820-acec-99edd81f2640'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.827832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] The token cache is being invalidate because project bad18e0465684dce9b5b6e9fbadfa186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:13:34.828231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.828814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-91d77077-c40f-4820-acec-99edd81f2640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:34.830334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 980/1936] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:13:34 2022] DELETE /identity/v3/projects/bad18e0465684dce9b5b6e9fbadfa186 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:13:34.835344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:34.835730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:34.836084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:34.857319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:34.858537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:34.921293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 957/1937] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:34.937707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:34.938038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:34.940646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:34.975975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:34.977302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:34.988114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 981/1938] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:34.994684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.011646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a6f7e-283f-42ec-ab83-967ce32ca7e2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.027687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.027687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.027687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.027687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.028691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:13:35.028691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.028691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.046427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 958/1939] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:13:35.049339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.059514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef82c1-a870-4689-af7c-88675efcff89 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.064286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.064903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.065182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.065461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.066114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.068115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.115443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 982/1940] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:13:35 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:13:35.118245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.128338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f43e-1975-4d12-a8f9-8c8153bdadb5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.188444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.189212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.189750 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.190161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.190911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.193290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.217658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 959/1941] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:13:35 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:13:35.222763 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.234839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a694-041d-420a-952f-b4158f48f927 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.239790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.240405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.240685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.240959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.241878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.243518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.254556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 983/1942] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:13:35.258816 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.268790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b0baa-2bd9-4542-a4fe-2b2b5b709cc9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.273893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b571bd-4808-498b-919b-8e5663e2d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.274478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b571bd-4808-498b-919b-8e5663e2d584 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.274760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b571bd-4808-498b-919b-8e5663e2d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.275026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b571bd-4808-498b-919b-8e5663e2d584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.275742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b571bd-4808-498b-919b-8e5663e2d584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.277316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b571bd-4808-498b-919b-8e5663e2d584 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.290610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 960/1943] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:13:35.294982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.305899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61da67-0386-4ee4-aac4-619f06aa9183 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.310544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.311215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.311522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.311797 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] PATH_INFO: `/v3/projects/d90bb9e25d0a42678a2fdae64a29492d/users/57bc7766647246f58656f8ab0aca6e19/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.328232 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90bb9e25d0a42678a2fdae64a29492d, user_id=57bc7766647246f58656f8ab0aca6e19, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.330942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.356617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 984/1944] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:13:35 2022] PUT /identity/v3/projects/d90bb9e25d0a42678a2fdae64a29492d/users/57bc7766647246f58656f8ab0aca6e19/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:35.373315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.373630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.373903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.387094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:35.403154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] MFA Rules not processed for user `57bc7766647246f58656f8ab0aca6e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:35.404436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:35.476777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 961/1945] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:35.490058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.492111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:35.574255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f15b-7e9e-4895-943c-677b7a781e98 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.578055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408eede-d895-4b05-98f4-d11ff673eb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.578671 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408eede-d895-4b05-98f4-d11ff673eb20 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.579084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408eede-d895-4b05-98f4-d11ff673eb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.579360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408eede-d895-4b05-98f4-d11ff673eb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.588879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408eede-d895-4b05-98f4-d11ff673eb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.590310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408eede-d895-4b05-98f4-d11ff673eb20 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.599140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 985/1946] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:35.624403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.702568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e1398-0d5d-48d1-9534-86b9be7195c9 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.707462 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.708102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.708381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.708653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] PATH_INFO: `/v3/users/57bc7766647246f58656f8ab0aca6e19` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.709793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bc7766647246f58656f8ab0aca6e19)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.711800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:35.763701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bc7766647246f58656f8ab0aca6e19'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:35.771532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bc7766647246f58656f8ab0aca6e19'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:35.787532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bc7766647246f58656f8ab0aca6e19'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:35.788704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bc7766647246f58656f8ab0aca6e19'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:35.797515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bc7766647246f58656f8ab0aca6e19'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:35.805755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 962/1947] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:13:35 2022] DELETE /identity/v3/users/57bc7766647246f58656f8ab0aca6e19 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:35.810390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be571-e012-4725-8b2c-978ded02bdec None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.810816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be571-e012-4725-8b2c-978ded02bdec None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.811260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877be571-e012-4725-8b2c-978ded02bdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.834884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-877be571-e012-4725-8b2c-978ded02bdec None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:35.836039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-877be571-e012-4725-8b2c-978ded02bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:35.840007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:35.896772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 986/1948] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:35.908055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:35.910300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:35.935869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:35.982124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938727b-5bad-4ba7-9b0c-e36cd8008ada admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:35.985835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8903a-7660-4a6b-b298-1ea3d7e94477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:35.986512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8903a-7660-4a6b-b298-1ea3d7e94477 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:35.986860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8903a-7660-4a6b-b298-1ea3d7e94477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:35.987195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8903a-7660-4a6b-b298-1ea3d7e94477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:35.996956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8903a-7660-4a6b-b298-1ea3d7e94477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:35.998481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8903a-7660-4a6b-b298-1ea3d7e94477 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.008328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 963/1949] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:36.311297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be571-e012-4725-8b2c-978ded02bdec None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.312896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-877be571-e012-4725-8b2c-978ded02bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:36.326053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877be571-e012-4725-8b2c-978ded02bdec None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.331482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.332297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.333212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.333553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] PATH_INFO: `/v3/projects/d90bb9e25d0a42678a2fdae64a29492d` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.334890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90bb9e25d0a42678a2fdae64a29492d)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.337281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.392087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90bb9e25d0a42678a2fdae64a29492d', 'request_id': 'req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:36.399430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90bb9e25d0a42678a2fdae64a29492d', 'request_id': 'req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:36.409793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90bb9e25d0a42678a2fdae64a29492d', 'request_id': 'req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:36.421889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] The token cache is being invalidate because project d90bb9e25d0a42678a2fdae64a29492d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:13:36.422177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:36.422837 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8fd3382f-f4a2-4844-a180-a0a9a7f89c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:13:36.424389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 987/1950] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:13:36 2022] DELETE /identity/v3/projects/d90bb9e25d0a42678a2fdae64a29492d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:36.429230 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.429747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.429850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.449471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:36.450673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:36.510499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 964/1951] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:36.573938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.574236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.574503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.595169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:36.596449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:36.608196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 988/1952] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:36.610335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.622490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c302-a06a-4dbc-80df-1f598ee490ae None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.628033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.629085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.629617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.630102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.630976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:13:36.631370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.633166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.645488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 965/1953] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:13:36.649845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.658957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a00ae0-e9e6-49a7-b0dc-7f9fe7350e0c None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.664138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.664729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.665008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.665278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.665905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.667875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.694917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 989/1954] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:13:36 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:13:36.698995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.713353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067651-613d-4a4e-9dcd-32d4d610c3b3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.783847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.784453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.784733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.785001 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.785625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.787599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.809292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 966/1955] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:13:36 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:13:36.813417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.824439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0fc7-782f-46af-bb59-b37e0c66fd89 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.829248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.830092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.830368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.831706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.832515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.834272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.845502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 990/1956] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:13:36.856772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.870303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54fa80-abd9-4afd-8f91-bcc9449ac699 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.875603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74405f-7a50-4e1e-819e-6229b6c355f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.876214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74405f-7a50-4e1e-819e-6229b6c355f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.876578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74405f-7a50-4e1e-819e-6229b6c355f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.876860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74405f-7a50-4e1e-819e-6229b6c355f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.877618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74405f-7a50-4e1e-819e-6229b6c355f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.879206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74405f-7a50-4e1e-819e-6229b6c355f2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.891470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 967/1957] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:13:36.895764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:36.905775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3aa658-1472-40b0-9062-6fb4f1e59906 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:36.910459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:36.911111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.911387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.911693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] PATH_INFO: `/v3/projects/c983bffc187d4eec9f0395a84a237156/users/24c3109cb4704ceba466355dc9fdfd2d/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.927541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c983bffc187d4eec9f0395a84a237156, user_id=24c3109cb4704ceba466355dc9fdfd2d, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:36.930239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:36.946423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 991/1958] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:13:36 2022] PUT /identity/v3/projects/c983bffc187d4eec9f0395a84a237156/users/24c3109cb4704ceba466355dc9fdfd2d/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:13:36.951682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ddbd-eb23-4fe6-b0df-579682c73b3a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:36.952020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ddbd-eb23-4fe6-b0df-579682c73b3a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:36.952286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90ddbd-eb23-4fe6-b0df-579682c73b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:36.973840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ae90ddbd-eb23-4fe6-b0df-579682c73b3a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:36.975059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ae90ddbd-eb23-4fe6-b0df-579682c73b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:36.994331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:37.037543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 968/1959] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:13:37.048537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:37.050531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:37.089304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:37.112866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d315-b138-41d2-936c-740206f8bbf4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:37.116776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:37.117381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:37.117659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:37.117930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:37.126704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:37.128151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:37.138335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 992/1960] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:37.861473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb87c6-d00f-4f81-8a5f-c3f66f4d0c50 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:37.862056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb87c6-d00f-4f81-8a5f-c3f66f4d0c50 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:37.862253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb87c6-d00f-4f81-8a5f-c3f66f4d0c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:37.912445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-40fb87c6-d00f-4f81-8a5f-c3f66f4d0c50 None None] MFA Rules not processed for user `24c3109cb4704ceba466355dc9fdfd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:37.913684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-40fb87c6-d00f-4f81-8a5f-c3f66f4d0c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:37.982693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 969/1961] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:13:37.994203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:37.995624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:38.058506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4c490-7f5e-4e10-9f8f-d87dad3f2ae9 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:38.062709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf177-a29e-477b-a362-93ca87717659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:38.064397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf177-a29e-477b-a362-93ca87717659 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:38.064894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf177-a29e-477b-a362-93ca87717659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:38.065171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf177-a29e-477b-a362-93ca87717659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:38.078315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf177-a29e-477b-a362-93ca87717659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:38.079808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf177-a29e-477b-a362-93ca87717659 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:38.091182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 993/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:13:39.509740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094bf63-9d10-485e-b18a-022982039578 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:39.510317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094bf63-9d10-485e-b18a-022982039578 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:39.510317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094bf63-9d10-485e-b18a-022982039578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:39.529607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d094bf63-9d10-485e-b18a-022982039578 None None] MFA Rules not processed for user `24c3109cb4704ceba466355dc9fdfd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:39.530815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d094bf63-9d10-485e-b18a-022982039578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:39.537942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 970/1963] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:48.086342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=39 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:49.524278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=51 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:54.123924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1532d-7505-4589-8116-7218e3a2355c None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:54.124378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1532d-7505-4589-8116-7218e3a2355c None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:54.124477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1532d-7505-4589-8116-7218e3a2355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:54.143259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-49b1532d-7505-4589-8116-7218e3a2355c None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:13:54.144488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-49b1532d-7505-4589-8116-7218e3a2355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:54.198477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 994/1964] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:13:54.220064 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094bf63-9d10-485e-b18a-022982039578 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:13:54.221449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d094bf63-9d10-485e-b18a-022982039578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:13:54.289540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094bf63-9d10-485e-b18a-022982039578 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:13:54.294672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17843f6-3fdd-4246-96e3-9dfcaad4a5e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:13:54.295283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17843f6-3fdd-4246-96e3-9dfcaad4a5e4 service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:13:54.295597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17843f6-3fdd-4246-96e3-9dfcaad4a5e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:13:54.295875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17843f6-3fdd-4246-96e3-9dfcaad4a5e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:13:54.303853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17843f6-3fdd-4246-96e3-9dfcaad4a5e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:13:54.305443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17843f6-3fdd-4246-96e3-9dfcaad4a5e4 service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:13:54.313407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 971/1965] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:14:04.191758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=25 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:04.310162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=32 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:20.833322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:20.833820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:20.833820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:20.853282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] MFA Rules not processed for user `0b9ef1203b0b4af39dd66b252eace4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:20.854495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:20.907721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 995/1966] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:23.314272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9529-a8b1-4b41-9654-fd3d810916ab None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:23.314828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9529-a8b1-4b41-9654-fd3d810916ab None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:23.314828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9529-a8b1-4b41-9654-fd3d810916ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:23.335775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3c7f9529-a8b1-4b41-9654-fd3d810916ab None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:23.337226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3c7f9529-a8b1-4b41-9654-fd3d810916ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:23.346698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 972/1967] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:23.367221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:14:23.368557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:23.447187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32220dd7-984c-4e23-a8bd-ddd99c7c2fea None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:14:23.452885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:14:23.453493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:23.453774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:23.454048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:23.462237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:14:23.464088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:14:23.474594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 996/1968] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:14:29.343300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50b0ec-3eaf-4dc8-8c48-a1ebaf430eb0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:29.344210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50b0ec-3eaf-4dc8-8c48-a1ebaf430eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:29.344470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50b0ec-3eaf-4dc8-8c48-a1ebaf430eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:29.364204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-0c50b0ec-3eaf-4dc8-8c48-a1ebaf430eb0 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:29.365403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0c50b0ec-3eaf-4dc8-8c48-a1ebaf430eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:29.373783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 973/1969] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:29.387172 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:14:29.398665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a30d-8b53-4f82-9546-1cb856adaa52 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:14:29.404653 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:14:29.405760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:29.406039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:29.406307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:29.414598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:14:29.416208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:14:29.426233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 997/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:14:36.719275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3c68-00e7-4cc2-bc76-1d085246832b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:36.719916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3c68-00e7-4cc2-bc76-1d085246832b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:36.719916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3c68-00e7-4cc2-bc76-1d085246832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:36.744249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-77af3c68-00e7-4cc2-bc76-1d085246832b None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:36.745448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-77af3c68-00e7-4cc2-bc76-1d085246832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:36.753683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 974/1971] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:36.767555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:14:36.778621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5b889-bacc-466d-bbde-d0824547ee14 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:14:36.784970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:14:36.785655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:36.786003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:36.786346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:36.795138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:14:36.797775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:14:36.813957 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 998/1972] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:14:41.872400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a518e8-3ff2-4629-bf79-64ec9034a625 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:41.872885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a518e8-3ff2-4629-bf79-64ec9034a625 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:41.872996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a518e8-3ff2-4629-bf79-64ec9034a625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:41.891921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b8a518e8-3ff2-4629-bf79-64ec9034a625 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:41.893143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b8a518e8-3ff2-4629-bf79-64ec9034a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:41.900909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 975/1973] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:41.916956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:14:41.918333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:41.933170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3688822-2bf3-4100-8822-998487d55c8c service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:14:41.938620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:14:41.939230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:41.939545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:41.939813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:41.947630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:14:41.949179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:14:41.958326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 999/1974] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:14:46.069566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc6da-c88e-44e9-ab7a-e1c155dc450f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:46.070034 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc6da-c88e-44e9-ab7a-e1c155dc450f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:46.070132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc6da-c88e-44e9-ab7a-e1c155dc450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:46.077693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=13 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:46.090799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-642bc6da-c88e-44e9-ab7a-e1c155dc450f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:46.092018 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-642bc6da-c88e-44e9-ab7a-e1c155dc450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:46.100440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 976/1975] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:46.115299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:14:46.120947 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=78 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:46.128199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bff2-ebf5-4dce-b898-3acc55092e44 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:14:46.133696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:14:46.134289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:46.134567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:46.134839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:46.143274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:14:46.144881 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:14:46.154176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1000/1976] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:14:50.243563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:50.244077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:50.244190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:50.264337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:14:50.265619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:14:50.274051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 977/1977] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:14:50.288241 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:14:50.299134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218fe3-d4e2-4cfd-9c63-27566cf59b57 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:14:50.304666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:14:50.305277 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:14:50.305592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:14:50.305846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:14:50.314493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:14:50.316114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:14:50.326295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1001/1978] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:00.259350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:00.321840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=11 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:03.269025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:03.270672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:03.283683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f730d-96c6-4cb7-b38e-93ee12b8c005 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:03.288737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:03.289650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:03.290117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:03.290388 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:03.292407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:03.308895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:03.310338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167f37-c4f0-420a-8cf6-b3d66b6ba66f service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:03.323620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 978/1979] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:04.501219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:04.511022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a9a6e-d28a-4aaa-95c7-c7c4f57f774c service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:04.515390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:04.516386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:04.517058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:04.517639 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:04.520276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:04.537238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:04.538753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:04.550800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1002/1980] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:07.611331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa496-bb32-4ce5-8d31-bab1de978f2b None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:07.611935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa496-bb32-4ce5-8d31-bab1de978f2b None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:07.612041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa496-bb32-4ce5-8d31-bab1de978f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:07.631394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-13efa496-bb32-4ce5-8d31-bab1de978f2b None None] MFA Rules not processed for user `24c3109cb4704ceba466355dc9fdfd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:07.632657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-13efa496-bb32-4ce5-8d31-bab1de978f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:07.640373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 979/1981] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:14.545545 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=6 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:17.626529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=9 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:20.022720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:20.035130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ad9d-3c8c-46ed-8ac3-86f1e273f3f6 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:20.041317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:20.041912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:20.042188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:20.042456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:20.044122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:20.101792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:20.103358 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:20.112067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1003/1982] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:20.286288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744d403-de23-49f5-8131-f9e7186f5cfb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:20.286769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744d403-de23-49f5-8131-f9e7186f5cfb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:20.286880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744d403-de23-49f5-8131-f9e7186f5cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:20.305342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9744d403-de23-49f5-8131-f9e7186f5cfb None None] MFA Rules not processed for user `6f9396941e5548aebdd1cd5fb4dc9fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:20.306522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9744d403-de23-49f5-8131-f9e7186f5cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:20.313212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 980/1983] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:15:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:21.072667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:21.083776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965f045-a18f-484a-bc7a-1714c638d159 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:21.089901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:21.090531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:21.090805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:21.091073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:21.092834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:21.156602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:21.158203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:21.167339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1004/1984] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:25.443489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b340ec-ffd6-42c5-b71f-9c6e44394e15 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:25.444005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b340ec-ffd6-42c5-b71f-9c6e44394e15 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:25.444103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b340ec-ffd6-42c5-b71f-9c6e44394e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:25.465560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c6b340ec-ffd6-42c5-b71f-9c6e44394e15 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:25.466763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c6b340ec-ffd6-42c5-b71f-9c6e44394e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:25.474803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 981/1985] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:25.490485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:25.502802 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aea18-3be2-4838-b147-8cda4cabf914 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:25.508891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:25.509497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:25.509775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:25.510045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:25.518933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:25.520577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:25.530822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1005/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:30.888065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fde30-36be-4abf-b179-999955e88284 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:30.888639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fde30-36be-4abf-b179-999955e88284 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:30.888639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fde30-36be-4abf-b179-999955e88284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:30.919076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1e1fde30-36be-4abf-b179-999955e88284 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:30.920370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1e1fde30-36be-4abf-b179-999955e88284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:30.929154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 982/1987] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:30.960923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:30.972813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823ce18-1557-4567-9e7a-4b4d9670adbf service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:30.978335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:30.979056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:30.979541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:30.979815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:30.988193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:30.989982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:31.001856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1006/1988] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:31.374144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:31.374430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:31.374734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:31.393566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] MFA Rules not processed for user `cdcf94479e2f4ca7bdf455dbab82e336`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:31.394763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:31.401505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 983/1989] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:31.703366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:31.712845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa8ff-6413-43e0-82fc-70d3d50266ec service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:31.716455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:31.717058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:31.717333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:31.717603 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:31.719334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:31.729832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:31.731243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:31.739029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1007/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:32.051509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:32.053110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:32.123420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66e9ba-e1bc-4775-ae17-42e0187e8ac8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:32.128593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:32.129203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:32.129487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:32.129800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:32.131843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:32.143791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:32.145371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6d8a-d2da-463c-860e-66fd9181dbcb service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:32.155759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 984/1991] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:33.206706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:33.217489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68be3c-28c3-41b7-befe-e9d93eb9d14c service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:33.221475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:33.222166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:33.222507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:33.222850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:33.224645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:33.235873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:33.237625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:33.245996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1008/1992] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:35.022362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5a83f-8c6c-4128-b5d4-90b3d3590f39 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:35.022869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5a83f-8c6c-4128-b5d4-90b3d3590f39 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:35.023030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5a83f-8c6c-4128-b5d4-90b3d3590f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:35.043393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-81c5a83f-8c6c-4128-b5d4-90b3d3590f39 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:35.044866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-81c5a83f-8c6c-4128-b5d4-90b3d3590f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:35.052903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 985/1993] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:35.067757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:35.083488 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960393cf-ae12-4d1f-bf70-c3cc9569627f service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:35.090354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:35.091061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:35.091438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:35.091787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:35.100774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:35.102874 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:35.113926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1009/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:39.211866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534a73-6df5-4237-909e-8788a34c031e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:39.212351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534a73-6df5-4237-909e-8788a34c031e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:39.212452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534a73-6df5-4237-909e-8788a34c031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:39.232236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-59534a73-6df5-4237-909e-8788a34c031e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:39.233408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-59534a73-6df5-4237-909e-8788a34c031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:39.241094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 986/1995] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:39.255629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:39.266784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99e2b5-6452-43fd-be54-d129990f2598 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:39.272161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:39.272745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:39.273046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:39.273314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:39.282649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:39.284251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:39.294324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1010/1996] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:43.383209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534a73-6df5-4237-909e-8788a34c031e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:43.413084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534a73-6df5-4237-909e-8788a34c031e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:43.421024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:43.422709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:43.423070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:43.423815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:43.425699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:43.441184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:43.443087 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7701c0-5362-4322-987d-dc2154f6ef9d service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:43.457916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 987/1997] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:44.832190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:44.837979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=93 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:44.855051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f007d7-e3e6-4306-bfbb-bebfa57f1f5b service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:44.861082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:44.862180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:44.862180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:44.862429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:44.864489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:44.879315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:44.881500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:44.893114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1011/1998] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:45.498552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64083c70-5c1b-48e4-8ea5-180915ec419d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:45.499031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64083c70-5c1b-48e4-8ea5-180915ec419d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:45.499121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64083c70-5c1b-48e4-8ea5-180915ec419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:45.528504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-64083c70-5c1b-48e4-8ea5-180915ec419d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:45.529751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-64083c70-5c1b-48e4-8ea5-180915ec419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:45.538789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 988/1999] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 13 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:15:45.557182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:45.568265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c875-3020-44a3-83e2-107a15232272 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:45.574048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:45.574678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:45.574955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:45.575225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:45.587496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:45.589136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:45.599268 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1012/2000] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:15:55.522722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=59 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:55.594681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=11 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:58.796339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:58.796339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:58.796832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:58.816093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:15:58.817292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:15:58.824687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 989/2001] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:15:58.876210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:15:58.887798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337711ce-a46f-4a04-ae82-564009dca877 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:15:58.893332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:15:58.893938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:15:58.894216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:15:58.894517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:15:58.903266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:15:58.904935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:15:58.912950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1013/2002] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:05.541016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:05.545589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:05.561493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211fcaa-8e0b-4f67-8381-606f6d98d667 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:05.566312 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:05.567067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:05.567439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:05.567824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] PATH_INFO: `/v3/users/9286b1b118e84552bc6118d15c92972a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:05.569062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9286b1b118e84552bc6118d15c92972a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:05.571081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:05.632102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9286b1b118e84552bc6118d15c92972a'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:05.640023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9286b1b118e84552bc6118d15c92972a'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:05.653926 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9286b1b118e84552bc6118d15c92972a'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:05.654654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9286b1b118e84552bc6118d15c92972a'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:05.662382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9286b1b118e84552bc6118d15c92972a'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:05.668950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 990/2003] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:16:05 2022] DELETE /identity/v3/users/9286b1b118e84552bc6118d15c92972a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:05.983901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:05.994460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7167d-425c-4d12-aa39-d6ad025d012b service swift] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:06.057035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:06.058220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.058491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.058755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] PATH_INFO: `/v3/projects/08d335e2fc1440e5a17ae65bcd8358cc` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.059924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d335e2fc1440e5a17ae65bcd8358cc)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:06.061815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:06.109801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d335e2fc1440e5a17ae65bcd8358cc', 'request_id': 'req-8bf6b14d-33b4-446e-9d3e-bd5581667e63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.116125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d335e2fc1440e5a17ae65bcd8358cc', 'request_id': 'req-8bf6b14d-33b4-446e-9d3e-bd5581667e63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.125041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d335e2fc1440e5a17ae65bcd8358cc', 'request_id': 'req-8bf6b14d-33b4-446e-9d3e-bd5581667e63'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.136611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] The token cache is being invalidate because project 08d335e2fc1440e5a17ae65bcd8358cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:16:06.136900 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.137526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.139012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1014/2004] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:16:05 2022] DELETE /identity/v3/projects/08d335e2fc1440e5a17ae65bcd8358cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:06.143003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:06.144570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:06.157788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83b60-1844-4bf0-8ace-ec5c7e39bf46 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:06.214809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:06.215471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.215756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.216027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] PATH_INFO: `/v3/users/7acd5b772072486f97101d82a0d391d8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.217173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acd5b772072486f97101d82a0d391d8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:06.219110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:06.265878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acd5b772072486f97101d82a0d391d8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.273131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acd5b772072486f97101d82a0d391d8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.281419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:06.287284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acd5b772072486f97101d82a0d391d8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.288190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acd5b772072486f97101d82a0d391d8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.297607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f523d60c-fb85-4db9-84d1-7ba07ec44ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acd5b772072486f97101d82a0d391d8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.304469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 991/2005] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:16:06 2022] DELETE /identity/v3/users/7acd5b772072486f97101d82a0d391d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:06.488402 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:06.490034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:06.507028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b14d-33b4-446e-9d3e-bd5581667e63 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:06.582605 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:06.583420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.583715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.584109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] PATH_INFO: `/v3/projects/4f548028fefb4ff09cf6292c23b78c04` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.585255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f548028fefb4ff09cf6292c23b78c04)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:06.587202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:06.615327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:06.648627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f548028fefb4ff09cf6292c23b78c04', 'request_id': 'req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.655301 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f548028fefb4ff09cf6292c23b78c04', 'request_id': 'req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.664989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f548028fefb4ff09cf6292c23b78c04', 'request_id': 'req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.677938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] The token cache is being invalidate because project 4f548028fefb4ff09cf6292c23b78c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:16:06.678229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.678889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-e5f80d6e-3a5f-4359-80b1-45d3e1e0e5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:06.680404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1015/2006] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:16:06 2022] DELETE /identity/v3/projects/4f548028fefb4ff09cf6292c23b78c04 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:06.686184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.686657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.686773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.707828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:06.709039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:06.781022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 992/2007] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:06.788501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.788893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.789239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.811175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:06.812963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:06.821308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1016/2008] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:16:06.825400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:06.835552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279d64-ccd2-4c70-b07a-bb894aa5683f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:06.840956 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:06.841859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.842144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.842416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.843067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:16:06.843369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:06.844996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:06.857637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 993/2009] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:16:06.862360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:06.876604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae590cd-cff9-49da-b686-b15441f169f8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:06.881814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:06.882538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.882884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.883222 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.884052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:06.886055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:06.921542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1017/2010] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:16:06 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:16:06.923092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:06.933242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d7b0-447c-4741-b93e-d1ca7529a742 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:06.989449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:06.990052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:06.990336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:06.990607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:06.991248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:06.993202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:07.014359 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 994/2011] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:16:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:16:07.018357 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:07.029127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34531e9f-a793-4043-b183-9f19a9c8f7fd admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:07.033752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:07.034345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:07.034624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:07.034895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:07.035574 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:07.037164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:07.047309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1018/2012] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:16:07.051195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:07.060959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ee57-7536-476d-9f93-e27501873535 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:07.065513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26820c8f-aee1-4765-a045-f51a55271713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:07.066093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820c8f-aee1-4765-a045-f51a55271713 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:07.066369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820c8f-aee1-4765-a045-f51a55271713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:07.066638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820c8f-aee1-4765-a045-f51a55271713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:07.067275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26820c8f-aee1-4765-a045-f51a55271713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:07.068878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26820c8f-aee1-4765-a045-f51a55271713 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:07.079116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 995/2013] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:16:07.082977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:07.093246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dc8be-026a-4ccb-aea2-7a2800cc02f5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:07.097783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:07.098417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:07.098697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:07.098970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] PATH_INFO: `/v3/projects/cebc99b946c7417aa5282b32e3bff9d9/users/ab02c441c43e44c3b207b2ed0976fdb1/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:07.113753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebc99b946c7417aa5282b32e3bff9d9, user_id=ab02c441c43e44c3b207b2ed0976fdb1, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:07.116414 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:07.129116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1019/2014] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:16:07 2022] PUT /identity/v3/projects/cebc99b946c7417aa5282b32e3bff9d9/users/ab02c441c43e44c3b207b2ed0976fdb1/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:16:07.134095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5268cc-e4f4-4396-8674-e3e54842993c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:07.134377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5268cc-e4f4-4396-8674-e3e54842993c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:07.134645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5268cc-e4f4-4396-8674-e3e54842993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:07.153701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ba5268cc-e4f4-4396-8674-e3e54842993c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:07.154884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ba5268cc-e4f4-4396-8674-e3e54842993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:07.197384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:07.213422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 996/2015] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:07.223586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:07.225347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:07.281294 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec12700-a866-469c-9884-15913cd1c2c4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:07.284915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:07.285519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:07.285798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:07.286072 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:07.295182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:07.296742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:07.306332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1020/2016] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:11.445878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.446351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.446480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.476561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] MFA Rules not processed for user `ab02c441c43e44c3b207b2ed0976fdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:11.477789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:11.553888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 997/2017] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:11.558480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:11.568716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cd289-d386-4a47-b69a-6f2cf1b7f2f0 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:11.573561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:11.574181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.574463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.574737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.575457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:11.577381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:11.607735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1021/2018] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:16:11 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:16:11.612098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:11.624365 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eedcb-5f48-4341-9781-6f7d87aa30dd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:11.683756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:11.684377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.684654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.684923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.685571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:11.687528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:11.710634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 998/2019] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:16:11 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:16:11.715735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:11.726520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c5e87-a6ab-4d6f-9b9e-6f2cbd335246 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:11.732376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:11.733065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.733352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.733622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.734303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:11.735939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:11.748612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1022/2020] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:16:11.752840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:11.763753 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3232d-92db-44e3-b428-ca337f0740f5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:11.768457 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:11.769098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.769377 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.769649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] PATH_INFO: `/v3/projects/649bd1b9ad174a7bab4fb0e617cdfb35/users/7bb64147d3234cad8b9b3d7bf4afa810/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.786158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649bd1b9ad174a7bab4fb0e617cdfb35, user_id=7bb64147d3234cad8b9b3d7bf4afa810, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:11.788864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:11.807165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 999/2021] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:16:11 2022] PUT /identity/v3/projects/649bd1b9ad174a7bab4fb0e617cdfb35/users/7bb64147d3234cad8b9b3d7bf4afa810/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:11.811835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:11.834579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213cdb0-8f1d-4f47-9f80-51651c4eeebb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:11.845073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:11.902041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:11.902792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.903099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.903390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.904068 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:11.906036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:11.927178 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1023/2022] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:16:11.928371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:11.939298 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7f179-1d01-4bd3-9dba-f84b5a351516 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:11.943927 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ef7d5-6c24-499a-b966-adbc5b967f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:11.944569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ef7d5-6c24-499a-b966-adbc5b967f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:11.944847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ef7d5-6c24-499a-b966-adbc5b967f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:11.945120 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ef7d5-6c24-499a-b966-adbc5b967f47 admin admin] PATH_INFO: `/v3/projects/649bd1b9ad174a7bab4fb0e617cdfb35/users/7bb64147d3234cad8b9b3d7bf4afa810/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:11.947008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ef7d5-6c24-499a-b966-adbc5b967f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649bd1b9ad174a7bab4fb0e617cdfb35, user_id=7bb64147d3234cad8b9b3d7bf4afa810, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:11.949728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ef7d5-6c24-499a-b966-adbc5b967f47 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:11.959754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1000/2023] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:16:11 2022] PUT /identity/v3/projects/649bd1b9ad174a7bab4fb0e617cdfb35/users/7bb64147d3234cad8b9b3d7bf4afa810/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:12.133905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:12.135903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:12.206102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d8d8-cd28-40b5-8c95-5b3a1bf2944b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:12.264325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:12.265110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:12.265469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:12.265839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:12.268018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:12.337055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:12.338640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:12.350117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1024/2024] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:17.696814 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:17.697325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:17.697436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:17.762713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] MFA Rules not processed for user `7bb64147d3234cad8b9b3d7bf4afa810`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:17.763898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:17.809917 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:17.909017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1001/2025] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:17.928107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:17.930165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:17.970248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:18.094255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10c77-99b6-4e7f-95a0-920df9ee6dae service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:18.107727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7641-3e8f-45dc-8fb1-43cdeab78e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:18.110967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7641-3e8f-45dc-8fb1-43cdeab78e16 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:18.111703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7641-3e8f-45dc-8fb1-43cdeab78e16 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:18.112321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7641-3e8f-45dc-8fb1-43cdeab78e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:18.206269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7641-3e8f-45dc-8fb1-43cdeab78e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:18.208247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7641-3e8f-45dc-8fb1-43cdeab78e16 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:18.221979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1025/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:20.491648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:20.493850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:20.624406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3b930-aec0-4052-b643-3f8fd1f60b16 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:20.631550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:20.632707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:20.633062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:20.633438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] PATH_INFO: `/v3/users/24c3109cb4704ceba466355dc9fdfd2d` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:20.635257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c3109cb4704ceba466355dc9fdfd2d)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:20.637923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:20.733566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c3109cb4704ceba466355dc9fdfd2d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:20.742686 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c3109cb4704ceba466355dc9fdfd2d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:20.758022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c3109cb4704ceba466355dc9fdfd2d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:20.759665 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c3109cb4704ceba466355dc9fdfd2d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:20.795166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c3109cb4704ceba466355dc9fdfd2d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:20.817837 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1002/2027] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:16:20 2022] DELETE /identity/v3/users/24c3109cb4704ceba466355dc9fdfd2d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:20.832174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b777f4-0a11-4cfb-b116-32f996e89cc2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:20.832732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b777f4-0a11-4cfb-b116-32f996e89cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:20.833204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b777f4-0a11-4cfb-b116-32f996e89cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:20.862895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-02b777f4-0a11-4cfb-b116-32f996e89cc2 None None] MFA Rules not processed for user `ab02c441c43e44c3b207b2ed0976fdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:20.864995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-02b777f4-0a11-4cfb-b116-32f996e89cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:20.956892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1026/2028] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:21.150348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:21.152817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:21.232121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:21.309334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cd22a-9923-4cbf-bca7-6f3f9ecfe5c1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:21.323890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:21.325150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:21.325429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:21.325880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] PATH_INFO: `/v3/projects/c983bffc187d4eec9f0395a84a237156` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:21.327372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c983bffc187d4eec9f0395a84a237156)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:21.329267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:21.445551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c983bffc187d4eec9f0395a84a237156', 'request_id': 'req-ed26a8d3-4ede-49d2-b78e-e678c5575f58'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:21.464373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c983bffc187d4eec9f0395a84a237156', 'request_id': 'req-ed26a8d3-4ede-49d2-b78e-e678c5575f58'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:21.486068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c983bffc187d4eec9f0395a84a237156', 'request_id': 'req-ed26a8d3-4ede-49d2-b78e-e678c5575f58'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:21.511660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] The token cache is being invalidate because project c983bffc187d4eec9f0395a84a237156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:16:21.512277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:21.514287 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:16:21.519888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1003/2029] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:16:21 2022] DELETE /identity/v3/projects/c983bffc187d4eec9f0395a84a237156 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:16:22.044159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18dfe3-f1a6-4bda-b195-aac2735c4f09 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:22.045025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18dfe3-f1a6-4bda-b195-aac2735c4f09 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:22.045755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18dfe3-f1a6-4bda-b195-aac2735c4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:22.065849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ba18dfe3-f1a6-4bda-b195-aac2735c4f09 None None] MFA Rules not processed for user `506adca00a91411e83a369c937538ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:22.067078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ba18dfe3-f1a6-4bda-b195-aac2735c4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:22.132147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1027/2030] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:22.537038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:22.539044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:22.613749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26a8d3-4ede-49d2-b78e-e678c5575f58 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:22.618644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:22.619163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:22.619478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:22.619914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:22.621984 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:22.633068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:22.634526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:22.644117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1004/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:29.907674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6555-c24c-490c-abac-1447f1479293 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:29.908199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6555-c24c-490c-abac-1447f1479293 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:29.908396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6555-c24c-490c-abac-1447f1479293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:29.923280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:29.928790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-102c6555-c24c-490c-abac-1447f1479293 None None] MFA Rules not processed for user `0b9ef1203b0b4af39dd66b252eace4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:16:29.930097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-102c6555-c24c-490c-abac-1447f1479293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:29.986088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1028/2032] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:16:32.639781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:33.859540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:33.861822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:33.962403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853e92-eaa4-427d-9fb1-69adb7a32e98 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:33.969329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:33.969940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:33.970225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:33.970502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:33.972266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:33.986107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:33.987943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:34.000739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1005/2033] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:39.978028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=22 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:43.995026 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=34 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:44.738537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6555-c24c-490c-abac-1447f1479293 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:44.753111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6555-c24c-490c-abac-1447f1479293 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:44.762808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:44.764960 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:44.765244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:44.765548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:44.768555 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:44.781636 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:44.783984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:44.799609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1029/2034] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:54.791867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=6 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:57.862619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:57.872202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3286-ed2b-495a-a16e-301dd5081b71 service nova] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:57.875791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:57.876890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:57.877169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:57.877440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:57.879145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:57.940905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:57.942274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:57.951674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1006/2035] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:16:58.610625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:16:58.612696 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:58.624528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f314-a2de-47bf-8628-2f25555dfd24 service nova] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:16:58.628094 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:16:58.628688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:16:58.628959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:16:58.629229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:16:58.631306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:16:58.700558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:16:58.702002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:16:58.712978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1030/2036] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:01.940845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:01.942286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:02.011704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.013428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:02.028701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa9df-e5ec-47fb-a869-344700ea28fe service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.033764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.034343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.034621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.034894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] PATH_INFO: `/v3/users/6f9396941e5548aebdd1cd5fb4dc9fab` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.036275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9396941e5548aebdd1cd5fb4dc9fab)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.038247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.044345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62143e92-b7dd-4ce6-9362-df84a71356da service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.051047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.051720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.052003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.052279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.054080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:02.069429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.071187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.084014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1007/2037] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:02.111767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9396941e5548aebdd1cd5fb4dc9fab'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.112452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9396941e5548aebdd1cd5fb4dc9fab'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.124366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9396941e5548aebdd1cd5fb4dc9fab'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.133045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9396941e5548aebdd1cd5fb4dc9fab'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.133752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ceab79f9-50f5-4761-a920-99e8f2686fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9396941e5548aebdd1cd5fb4dc9fab'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.145857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1031/2038] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:02 2022] DELETE /identity/v3/users/6f9396941e5548aebdd1cd5fb4dc9fab => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:02.318302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.331374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32907dc1-255d-4600-ade4-14fc637219fa service placement] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.389007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.389631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.389909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.390176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] PATH_INFO: `/v3/projects/ed58ea6643854e398cc5add85b90026a` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.391290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed58ea6643854e398cc5add85b90026a)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.393222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.422954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:02.440135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed58ea6643854e398cc5add85b90026a', 'request_id': 'req-02e7220b-a27d-4a8c-81ca-339c0540479d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.446023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed58ea6643854e398cc5add85b90026a', 'request_id': 'req-02e7220b-a27d-4a8c-81ca-339c0540479d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.452562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed58ea6643854e398cc5add85b90026a', 'request_id': 'req-02e7220b-a27d-4a8c-81ca-339c0540479d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.462496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] The token cache is being invalidate because project ed58ea6643854e398cc5add85b90026a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:02.462779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.463423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-02e7220b-a27d-4a8c-81ca-339c0540479d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:02.464895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1008/2039] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:02 2022] DELETE /identity/v3/projects/ed58ea6643854e398cc5add85b90026a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:17:02.469707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.469988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.470259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.490645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:02.491870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:02.549693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1032/2040] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:02.557538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.557822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.558096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.577887 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:02.579082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:02.587075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1009/2041] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:02.591284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.601666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec40d9-de77-4e59-8617-5e9acefef94d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.606519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.607186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.607594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.607883 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.608523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:17:02.608823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.610433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.612554 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:02.625194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1033/2042] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:17:02.629160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.638784 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e459b5-86e0-4652-a5d5-1adb1b7fcafd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.645672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.646276 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.646558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.646828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.647502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.649438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.676066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1010/2043] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:17:02.680688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.690629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3020-2566-4b23-86a2-1c2062fff3ab admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.746971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.747614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.747897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.748170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.748804 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.750715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.772051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1034/2044] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:02 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:02.776473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.787136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c390f6-e2c0-4b0c-bf49-687e82b9c9ba admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.791712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.792306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.792581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.792852 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.793487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.795091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.805302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1011/2045] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:02.809198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.819005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae9e6f-c617-436e-98fa-9cea5fea7ee2 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.823586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbc70a-b327-4f98-a93b-859ae7efe56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.824181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbc70a-b327-4f98-a93b-859ae7efe56b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.824461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbc70a-b327-4f98-a93b-859ae7efe56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.824740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbc70a-b327-4f98-a93b-859ae7efe56b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.825377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbc70a-b327-4f98-a93b-859ae7efe56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.826967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbc70a-b327-4f98-a93b-859ae7efe56b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.837708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1035/2046] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:02.841620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:02.852131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9a0a-321f-4478-b9e5-278d292e0a44 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:02.856825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:02.857481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.857757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.858027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] PATH_INFO: `/v3/projects/0e5a2076681d413d955ce0d911dace88/users/b91f6419c64249caaa40d2f82dc15851/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.872089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5a2076681d413d955ce0d911dace88, user_id=b91f6419c64249caaa40d2f82dc15851, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:02.874721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:02.888393 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1012/2047] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:02 2022] PUT /identity/v3/projects/0e5a2076681d413d955ce0d911dace88/users/b91f6419c64249caaa40d2f82dc15851/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:17:02.900599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:02.900884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:02.901157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:02.928875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] MFA Rules not processed for user `b91f6419c64249caaa40d2f82dc15851`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:02.931130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:02.996351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1036/2048] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:03.000699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.065963 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1744a0-ced8-4c62-b849-0b3dc929ac70 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.070503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.071099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.071371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.071666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.072285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.074176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.100040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1013/2049] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:02 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:03.104164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.114585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b7ee4-5678-4503-b847-e45fe98b22aa None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.170561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.171154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.171490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.171757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.172386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.174333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.182998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:03.196765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1037/2050] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:03 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:03.200766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.211578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026182-09a1-4aac-984b-9865bafbf5c8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.216139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.216727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.217005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.217277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.217912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.219574 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.230031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1014/2051] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:17:03.234042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.243787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cbea2-16af-4588-98d0-d6e4d4462f94 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.248301 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.248926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.249206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.249476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] PATH_INFO: `/v3/projects/513ac0afc93a446880f4393bc8eb17a7/users/61f1cd42cae24ca8854b6ca6a376fabd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.265110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513ac0afc93a446880f4393bc8eb17a7, user_id=61f1cd42cae24ca8854b6ca6a376fabd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.268351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.281429 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1038/2052] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:03 2022] PUT /identity/v3/projects/513ac0afc93a446880f4393bc8eb17a7/users/61f1cd42cae24ca8854b6ca6a376fabd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:03.285209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.295445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605159-8efe-4551-b68d-13cd36ab2cd2 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.315396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:03.353502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28d9bd-d870-476f-8f69-eaa8b7f7dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.354099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28d9bd-d870-476f-8f69-eaa8b7f7dfaa admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.354372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28d9bd-d870-476f-8f69-eaa8b7f7dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.354643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28d9bd-d870-476f-8f69-eaa8b7f7dfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.355271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28d9bd-d870-476f-8f69-eaa8b7f7dfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.356878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28d9bd-d870-476f-8f69-eaa8b7f7dfaa admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.366705 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1015/2053] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:03.370870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.381352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912c8b4-cf2f-4716-a213-6e4b57409f58 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.386269 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.387034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.387309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.387604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] PATH_INFO: `/v3/projects/513ac0afc93a446880f4393bc8eb17a7/users/61f1cd42cae24ca8854b6ca6a376fabd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.389486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] RBAC: Authorizing `identity:create_grant(project_id=513ac0afc93a446880f4393bc8eb17a7, user_id=61f1cd42cae24ca8854b6ca6a376fabd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.392136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.403927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1039/2054] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:03 2022] PUT /identity/v3/projects/513ac0afc93a446880f4393bc8eb17a7/users/61f1cd42cae24ca8854b6ca6a376fabd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:03.414375 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.414656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.414924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.442586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] MFA Rules not processed for user `61f1cd42cae24ca8854b6ca6a376fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:03.443805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:03.509791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1016/2055] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:03.521201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:03.522911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:03.579139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d578fd-ba2d-4b78-9a2f-b08da766038a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:03.583576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:03.584180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:03.584460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:03.584732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:03.643019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:03.644486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:03.653205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1040/2056] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:05.004177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:05.005563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:05.017511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361cff2-8208-4473-856e-4ef8f643bc15 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:05.021554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dfc33-95e0-4d3c-9138-2f4831458af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:05.022145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dfc33-95e0-4d3c-9138-2f4831458af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:05.022429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dfc33-95e0-4d3c-9138-2f4831458af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:05.022726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dfc33-95e0-4d3c-9138-2f4831458af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:05.031639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dfc33-95e0-4d3c-9138-2f4831458af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:05.033086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dfc33-95e0-4d3c-9138-2f4831458af7 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:05.043090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1017/2057] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:08.813014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:08.873433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871564f-8767-49fd-9e1e-710a5f014544 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:08.879208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:08.879379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:08.879684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:08.879956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] PATH_INFO: `/v3/users/b91f6419c64249caaa40d2f82dc15851` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:08.881114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91f6419c64249caaa40d2f82dc15851)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:08.883301 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:08.894735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:08.929769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91f6419c64249caaa40d2f82dc15851'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:08.930432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91f6419c64249caaa40d2f82dc15851'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:08.941868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91f6419c64249caaa40d2f82dc15851'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:08.949144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91f6419c64249caaa40d2f82dc15851'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:08.949951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91f6419c64249caaa40d2f82dc15851'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:08.963810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1041/2058] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:08 2022] DELETE /identity/v3/users/b91f6419c64249caaa40d2f82dc15851 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:08.968347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:08.968819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:08.968915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:08.987799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:08.988923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:09.046971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1018/2059] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:09.056590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:09.058009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:09.114617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7293-0fb2-40df-86b2-86c6d4056561 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:09.118327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:09.118933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:09.119243 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:09.119550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:09.132007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:09.133678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:09.143840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1042/2060] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:09.411748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:09.413335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:09.425965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a7ade-a2af-49a3-8f6a-12fcf3f44692 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:09.431510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:09.432368 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:09.432652 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:09.433233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] PATH_INFO: `/v3/projects/0e5a2076681d413d955ce0d911dace88` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:09.434515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5a2076681d413d955ce0d911dace88)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:09.436581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:09.477677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:09.495438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5a2076681d413d955ce0d911dace88', 'request_id': 'req-6903acb8-b3e8-4338-ae2e-8d59b92c3667'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.501556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5a2076681d413d955ce0d911dace88', 'request_id': 'req-6903acb8-b3e8-4338-ae2e-8d59b92c3667'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.511774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5a2076681d413d955ce0d911dace88', 'request_id': 'req-6903acb8-b3e8-4338-ae2e-8d59b92c3667'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.523960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] The token cache is being invalidate because project 0e5a2076681d413d955ce0d911dace88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:09.523960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.524690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.526487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1019/2061] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:09 2022] DELETE /identity/v3/projects/0e5a2076681d413d955ce0d911dace88 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:09.530302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:09.541318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950a41-c0a1-4aaf-9a11-62d40d848aee service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:09.601855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:09.602592 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:09.602953 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:09.603291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] PATH_INFO: `/v3/users/61f1cd42cae24ca8854b6ca6a376fabd` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:09.604594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f1cd42cae24ca8854b6ca6a376fabd)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:09.606656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:09.642840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:09.656952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f1cd42cae24ca8854b6ca6a376fabd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.657627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f1cd42cae24ca8854b6ca6a376fabd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.669879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f1cd42cae24ca8854b6ca6a376fabd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.677393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f1cd42cae24ca8854b6ca6a376fabd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.678079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-7cbe2c21-0f8e-44c3-a9f1-427063cbd5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f1cd42cae24ca8854b6ca6a376fabd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:09.690673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1043/2062] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:09 2022] DELETE /identity/v3/users/61f1cd42cae24ca8854b6ca6a376fabd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:09.962037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:09.963493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:09.978130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903acb8-b3e8-4338-ae2e-8d59b92c3667 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.036915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.037552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.037835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.038114 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] PATH_INFO: `/v3/projects/513ac0afc93a446880f4393bc8eb17a7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.039314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=513ac0afc93a446880f4393bc8eb17a7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.041226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.095921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513ac0afc93a446880f4393bc8eb17a7', 'request_id': 'req-f6295b9b-45c4-4fb3-b046-e88f2235f64b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:10.102497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513ac0afc93a446880f4393bc8eb17a7', 'request_id': 'req-f6295b9b-45c4-4fb3-b046-e88f2235f64b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:10.109951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513ac0afc93a446880f4393bc8eb17a7', 'request_id': 'req-f6295b9b-45c4-4fb3-b046-e88f2235f64b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:10.120226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] The token cache is being invalidate because project 513ac0afc93a446880f4393bc8eb17a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:10.120512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:10.121137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f6295b9b-45c4-4fb3-b046-e88f2235f64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:10.122625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1020/2063] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:09 2022] DELETE /identity/v3/projects/513ac0afc93a446880f4393bc8eb17a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:10.127599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.128084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.128191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.148330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:10.149550 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:10.215184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1044/2064] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:10.223487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.223776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.224052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.243138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:10.244378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:10.252523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1021/2065] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:17:10.256967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.266825 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ef6a-41c2-492d-b2e4-cedce46dce04 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.271855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.272448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.272726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.272997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.273647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:17:10.273948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.275567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.287453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1045/2066] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:17:10.291749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.300717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd16408-b24d-478d-a0a4-eee5e57a919c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.305456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.306042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.306317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.306584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.307200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.309225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.336592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1022/2067] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:10.340969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.351465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296826-6671-4965-9756-d56b1c35930c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.406475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.407073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.407348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.407644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.408263 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.410709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.431489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1046/2068] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:10.435821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.445743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e389d4-0e17-401c-a60a-45ad6c346618 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.450217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.450804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.451081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.451351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.452019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.453611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.463849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1023/2069] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:17:10.467787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.478161 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2cde-0e97-4866-8c2e-3959c5ed7b8b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.482793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc87f6-2581-435a-8b19-fafa01d6fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.483381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc87f6-2581-435a-8b19-fafa01d6fdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.483689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc87f6-2581-435a-8b19-fafa01d6fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.483962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc87f6-2581-435a-8b19-fafa01d6fdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.484599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc87f6-2581-435a-8b19-fafa01d6fdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.486176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc87f6-2581-435a-8b19-fafa01d6fdbb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.497020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1047/2070] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:10.501165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.511890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d527a-3d10-47a3-b06d-3c55ec20abb2 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.516439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.517078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.517354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.517624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] PATH_INFO: `/v3/projects/d9aa61196d1749d3b0be3aab97ea9846/users/90fe5172c9124600b5b1773d45b59646/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.520423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:10.536335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9aa61196d1749d3b0be3aab97ea9846, user_id=90fe5172c9124600b5b1773d45b59646, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.539033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.551467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1024/2071] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:10 2022] PUT /identity/v3/projects/d9aa61196d1749d3b0be3aab97ea9846/users/90fe5172c9124600b5b1773d45b59646/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:10.563143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.563459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.563739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.592076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] MFA Rules not processed for user `90fe5172c9124600b5b1773d45b59646`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:10.593317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:10.597439 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:10.659056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1048/2072] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:10.663646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.732950 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72e687-73d3-4b6e-bdb9-4518524d03b6 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.737696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.738286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.738563 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.738833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.739493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.741400 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.768867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1025/2073] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:10.772948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.783518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bf818-2481-4741-873b-fb9629c08824 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.841563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.842169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.842445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.842718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.843336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.845279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.867612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1049/2074] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:10 2022] POST /identity/v3/users => generated 310 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:10.871918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.882655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b317e-6279-44dc-83a1-b2ca1472dfa7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.887790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.888394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.888673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.888942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.889590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.891182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.901743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1026/2075] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:10.906030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.916063 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9647-e920-4b32-8cc7-9f524f69e56b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:10.920687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:10.921337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:10.921619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:10.921894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] PATH_INFO: `/v3/projects/20683586b02d4db6b285386c4114da1e/users/7be001434acd460c861855a0c2a25d06/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:10.936862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20683586b02d4db6b285386c4114da1e, user_id=7be001434acd460c861855a0c2a25d06, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:10.939552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:10.952473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1050/2076] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:10 2022] PUT /identity/v3/projects/20683586b02d4db6b285386c4114da1e/users/7be001434acd460c861855a0c2a25d06/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:10.957051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:10.967253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ced85-2d48-4930-8c43-b1c81969d81a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:11.023067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111701f-0d3c-4f5c-9194-ca19672e0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:11.023755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111701f-0d3c-4f5c-9194-ca19672e0bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:11.023978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111701f-0d3c-4f5c-9194-ca19672e0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:11.024252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111701f-0d3c-4f5c-9194-ca19672e0bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:11.024902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111701f-0d3c-4f5c-9194-ca19672e0bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:11.026522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111701f-0d3c-4f5c-9194-ca19672e0bf1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:11.040220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1027/2077] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:17:11.041499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:11.053873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13eacd-88b6-43ce-bc26-71c147dedd39 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:11.058609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:11.059260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:11.059569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:11.059842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] PATH_INFO: `/v3/projects/20683586b02d4db6b285386c4114da1e/users/7be001434acd460c861855a0c2a25d06/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:11.061926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20683586b02d4db6b285386c4114da1e, user_id=7be001434acd460c861855a0c2a25d06, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:11.064964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:11.078500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1051/2078] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:11 2022] PUT /identity/v3/projects/20683586b02d4db6b285386c4114da1e/users/7be001434acd460c861855a0c2a25d06/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:11.088351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:11.088643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:11.088925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:11.117456 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] MFA Rules not processed for user `7be001434acd460c861855a0c2a25d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:11.118682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:11.161016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:11.189165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1028/2079] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:11 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:11.201367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:11.203082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:11.264490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af6b58-1573-44ae-bdec-f8853de59a5a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:11.268296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:11.268921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:11.269201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:11.269474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:11.294056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:11.294216 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:11.300932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:11.307165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1052/2080] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:11 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:17:11.463180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:11.472673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ae999-daa6-4061-b733-8bce1b1c5366 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:11.476177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348b87-52df-4864-ae2b-49e4f56a5797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:11.476770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348b87-52df-4864-ae2b-49e4f56a5797 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:11.477050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348b87-52df-4864-ae2b-49e4f56a5797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:11.477567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348b87-52df-4864-ae2b-49e4f56a5797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:11.533057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3348b87-52df-4864-ae2b-49e4f56a5797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:11.534527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3348b87-52df-4864-ae2b-49e4f56a5797 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:11.543661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1029/2081] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:16.815590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:16.876513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184291f-acf9-42b8-beb8-9ccf36ca98e6 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:16.881015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:16.881635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:16.881918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:16.882190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] PATH_INFO: `/v3/users/90fe5172c9124600b5b1773d45b59646` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:16.883988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fe5172c9124600b5b1773d45b59646)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:16.885720 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:16.932702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fe5172c9124600b5b1773d45b59646'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:16.933365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fe5172c9124600b5b1773d45b59646'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:16.945588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fe5172c9124600b5b1773d45b59646'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:16.952946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fe5172c9124600b5b1773d45b59646'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:16.953666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fe5172c9124600b5b1773d45b59646'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:16.969354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1053/2082] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:16 2022] DELETE /identity/v3/users/90fe5172c9124600b5b1773d45b59646 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:16.974553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:16.975141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:16.975141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:16.994560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:16.995888 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:17.059165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1030/2083] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:17.069149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:17.070672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:17.130599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112052b-7f42-4604-92a5-3d49b2dc377f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:17.134606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:17.135224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:17.135534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:17.135811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:17.146309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:17.147798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:17.158082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1054/2084] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:17.425209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:17.426597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:17.438834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15608-599e-4437-a71d-bfc4841c254c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:17.443945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:17.444570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:17.444854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:17.445128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] PATH_INFO: `/v3/projects/d9aa61196d1749d3b0be3aab97ea9846` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:17.446422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9aa61196d1749d3b0be3aab97ea9846)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:17.448391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:17.494163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9aa61196d1749d3b0be3aab97ea9846', 'request_id': 'req-a8c0a15e-e512-445d-87d9-cf24817ce667'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.500129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9aa61196d1749d3b0be3aab97ea9846', 'request_id': 'req-a8c0a15e-e512-445d-87d9-cf24817ce667'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.507569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9aa61196d1749d3b0be3aab97ea9846', 'request_id': 'req-a8c0a15e-e512-445d-87d9-cf24817ce667'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.514703 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:17.518921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] The token cache is being invalidate because project d9aa61196d1749d3b0be3aab97ea9846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:17.519854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.521263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.522839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1031/2085] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:17 2022] DELETE /identity/v3/projects/d9aa61196d1749d3b0be3aab97ea9846 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:17:17.526975 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:17.536736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd68a5b-2090-4cf7-be42-2085c8b9d253 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:17.555480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:17.594637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:17.595259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:17.595581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:17.595856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] PATH_INFO: `/v3/users/7be001434acd460c861855a0c2a25d06` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:17.596970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be001434acd460c861855a0c2a25d06)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:17.598889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:17.644228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be001434acd460c861855a0c2a25d06'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.644989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be001434acd460c861855a0c2a25d06'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.656733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be001434acd460c861855a0c2a25d06'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.663925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be001434acd460c861855a0c2a25d06'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.664535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6daccc6f-7982-416e-9065-5322d4a5080a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be001434acd460c861855a0c2a25d06'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:17.677313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1055/2086] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:17 2022] DELETE /identity/v3/users/7be001434acd460c861855a0c2a25d06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:17:17.945451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:17.946884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:17.960439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0a15e-e512-445d-87d9-cf24817ce667 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.016866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.017477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.017773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.018039 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] PATH_INFO: `/v3/projects/20683586b02d4db6b285386c4114da1e` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.019154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20683586b02d4db6b285386c4114da1e)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.021244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.066268 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20683586b02d4db6b285386c4114da1e', 'request_id': 'req-cbe0de9f-e675-4bb5-86e0-44d08e08698d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:18.072196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20683586b02d4db6b285386c4114da1e', 'request_id': 'req-cbe0de9f-e675-4bb5-86e0-44d08e08698d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:18.079141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20683586b02d4db6b285386c4114da1e', 'request_id': 'req-cbe0de9f-e675-4bb5-86e0-44d08e08698d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:18.089343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] The token cache is being invalidate because project 20683586b02d4db6b285386c4114da1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:18.089667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:18.090349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cbe0de9f-e675-4bb5-86e0-44d08e08698d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:18.091907 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1032/2087] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:17 2022] DELETE /identity/v3/projects/20683586b02d4db6b285386c4114da1e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:18.096924 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.097939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.098041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.117827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:18.119040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:18.176204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1056/2088] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:18.183945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.184239 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.184517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.204897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:18.206041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:18.213839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1033/2089] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:18.217884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.228001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09162e92-8b9c-481a-a09a-afff8eea23e7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.232503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.233090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.233364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.233630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.234267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:17:18.234564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.236175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.247845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1057/2090] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:17:18.252326 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.261779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539005b-4dd5-47df-83a0-b593bd3bcc93 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.266398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.266987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.267262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.267572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.268209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.270106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.296834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1034/2091] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:17:18.301567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.311491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766abbaa-7a3e-4973-8813-03406ba0df64 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.336753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:18.371572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.372182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.372458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.372756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.373391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.375283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.400773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1058/2092] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:18.402068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.412473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b2dad-55a6-4cd2-9f75-265bdd30caa9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.416997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.417591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.417865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.418132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.418763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.420480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.431657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1035/2093] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:17:18.435681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.446306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982ccb6-aa36-4f75-85bb-fc9c932daf3b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.451724 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5345f4-63b0-4460-af58-78fb0a8c677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.452303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5345f4-63b0-4460-af58-78fb0a8c677b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.452584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5345f4-63b0-4460-af58-78fb0a8c677b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.452854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5345f4-63b0-4460-af58-78fb0a8c677b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.453495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5345f4-63b0-4460-af58-78fb0a8c677b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.455145 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5345f4-63b0-4460-af58-78fb0a8c677b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.465122 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1059/2094] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:18.469250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.479078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c3d66-cb13-493f-b619-f4876b25132b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.483769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.484410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.484687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.484959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] PATH_INFO: `/v3/projects/05f1e423f95c4fbdbab7110d79f314d2/users/60cd0f97465f49b39340066d8c4e11a6/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.499771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f1e423f95c4fbdbab7110d79f314d2, user_id=60cd0f97465f49b39340066d8c4e11a6, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.502415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.516129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1036/2095] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:18 2022] PUT /identity/v3/projects/05f1e423f95c4fbdbab7110d79f314d2/users/60cd0f97465f49b39340066d8c4e11a6/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:18.527396 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.527712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.527981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.556791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] MFA Rules not processed for user `60cd0f97465f49b39340066d8c4e11a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:18.557987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:18.620463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1060/2096] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:18.624952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.654663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:18.687509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842407-2b01-48c8-b838-ccf9ae99f5b5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.692642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.693236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.693514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.693785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.694417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.696364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.721890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1037/2097] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:18.726506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.737139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca2a1-a964-4bf9-8c17-840b66455e8f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.795296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.796049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.796325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.796594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.797221 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.799126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.819820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1061/2098] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:18 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:18.823805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.834055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00e742-5e54-4ec6-8ca4-8bd80ea16b5c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.838600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.839185 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.839493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.839874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.840517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.842111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.852914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1038/2099] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:18.856858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.867417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa213a3-137d-4cbb-89d6-218024a28a42 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.872028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.872669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.872948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.873245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] PATH_INFO: `/v3/projects/0165d042c889430c867227d38f523e87/users/e24f8727626b4fa59d62c3da560029e3/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.888080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0165d042c889430c867227d38f523e87, user_id=e24f8727626b4fa59d62c3da560029e3, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.890628 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.903325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1062/2100] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:18 2022] PUT /identity/v3/projects/0165d042c889430c867227d38f523e87/users/e24f8727626b4fa59d62c3da560029e3/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:18.907207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.917470 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423eda5-08c0-49c8-9457-9379cd560393 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:18.970616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1047a6-1efa-4abe-8d4e-26b246f35875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:18.971207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1047a6-1efa-4abe-8d4e-26b246f35875 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:18.971512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1047a6-1efa-4abe-8d4e-26b246f35875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:18.971787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1047a6-1efa-4abe-8d4e-26b246f35875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:18.972964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1047a6-1efa-4abe-8d4e-26b246f35875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:18.974487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1047a6-1efa-4abe-8d4e-26b246f35875 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:18.984002 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1039/2101] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:18.988580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:18.993932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:19.000307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726fbea-64f0-4aee-9c43-6100893e1a37 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:19.005297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:19.005943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:19.006224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:19.006499 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] PATH_INFO: `/v3/projects/0165d042c889430c867227d38f523e87/users/e24f8727626b4fa59d62c3da560029e3/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:19.008718 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0165d042c889430c867227d38f523e87, user_id=e24f8727626b4fa59d62c3da560029e3, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:19.011349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:19.021324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1063/2102] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:18 2022] PUT /identity/v3/projects/0165d042c889430c867227d38f523e87/users/e24f8727626b4fa59d62c3da560029e3/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:19.031294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:19.031793 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:19.031912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:19.060019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] MFA Rules not processed for user `e24f8727626b4fa59d62c3da560029e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:19.061219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:19.127933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1040/2103] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:19.138800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:19.140525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:19.196445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207cb4-d98c-454f-af51-c8256fe21db7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:19.200080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e02ddd-7c58-4b34-b1ec-8481db6cb05a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:19.200681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e02ddd-7c58-4b34-b1ec-8481db6cb05a service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:19.200954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e02ddd-7c58-4b34-b1ec-8481db6cb05a service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:19.201227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e02ddd-7c58-4b34-b1ec-8481db6cb05a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:19.210444 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e02ddd-7c58-4b34-b1ec-8481db6cb05a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:19.211903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e02ddd-7c58-4b34-b1ec-8481db6cb05a service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:19.221066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1064/2104] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:19.793390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:19.818628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:19.855297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999837c-bc3b-49c7-b25e-0b3645e7af6a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:19.859976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:19.860627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:19.860905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:19.861174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] PATH_INFO: `/v3/users/60cd0f97465f49b39340066d8c4e11a6` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:19.862324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cd0f97465f49b39340066d8c4e11a6)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:19.864786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:19.909795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cd0f97465f49b39340066d8c4e11a6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:19.916482 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cd0f97465f49b39340066d8c4e11a6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:19.928457 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cd0f97465f49b39340066d8c4e11a6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:19.929111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cd0f97465f49b39340066d8c4e11a6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:19.935754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cd0f97465f49b39340066d8c4e11a6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:19.942091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1041/2105] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:19 2022] DELETE /identity/v3/users/60cd0f97465f49b39340066d8c4e11a6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:19.946627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:19.946908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:19.947204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:19.965800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:19.966990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:20.023933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1065/2106] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:17:20.033521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:20.034933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:20.091299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3a42-e8d3-4de8-8e10-ec2c03b2094f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:20.094874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:20.095497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:20.095776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:20.096042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:20.104719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:20.106137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:20.115800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1042/2107] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:20.380149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:20.381757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:20.396157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d0064-1797-4464-9d4a-e5b27f34e005 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:20.400828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:20.401455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:20.401729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:20.401999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] PATH_INFO: `/v3/projects/05f1e423f95c4fbdbab7110d79f314d2` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:20.403140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f1e423f95c4fbdbab7110d79f314d2)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:20.405098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:20.450287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f1e423f95c4fbdbab7110d79f314d2', 'request_id': 'req-d6069d3c-4c41-445a-8201-c8a95bb9398b'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.456223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f1e423f95c4fbdbab7110d79f314d2', 'request_id': 'req-d6069d3c-4c41-445a-8201-c8a95bb9398b'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.463347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f1e423f95c4fbdbab7110d79f314d2', 'request_id': 'req-d6069d3c-4c41-445a-8201-c8a95bb9398b'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.473980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] The token cache is being invalidate because project 05f1e423f95c4fbdbab7110d79f314d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:20.474267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.474876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.476361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1066/2108] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:20 2022] DELETE /identity/v3/projects/05f1e423f95c4fbdbab7110d79f314d2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:20.480474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:20.490399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2fed-98ef-48ba-8078-ff1395ade599 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:20.530084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:20.546389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:20.547010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:20.547288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:20.547590 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] PATH_INFO: `/v3/users/e24f8727626b4fa59d62c3da560029e3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:20.548694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24f8727626b4fa59d62c3da560029e3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:20.551240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:20.596810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24f8727626b4fa59d62c3da560029e3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.604282 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24f8727626b4fa59d62c3da560029e3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.615798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24f8727626b4fa59d62c3da560029e3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.616478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24f8727626b4fa59d62c3da560029e3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.623528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f85af170-f754-4f25-8acb-3c181e5477f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24f8727626b4fa59d62c3da560029e3'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:20.629357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1043/2109] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:20 2022] DELETE /identity/v3/users/e24f8727626b4fa59d62c3da560029e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:20.927606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:20.929299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:20.947989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069d3c-4c41-445a-8201-c8a95bb9398b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:20.964349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:21.010401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.011022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.011296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.011594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] PATH_INFO: `/v3/projects/0165d042c889430c867227d38f523e87` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.012695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0165d042c889430c867227d38f523e87)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.014569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.058435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0165d042c889430c867227d38f523e87', 'request_id': 'req-59c632ba-7453-4e05-99b8-f935dd96dca8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:21.064366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0165d042c889430c867227d38f523e87', 'request_id': 'req-59c632ba-7453-4e05-99b8-f935dd96dca8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:21.073157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0165d042c889430c867227d38f523e87', 'request_id': 'req-59c632ba-7453-4e05-99b8-f935dd96dca8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:21.083860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] The token cache is being invalidate because project 0165d042c889430c867227d38f523e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:21.084148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:21.084764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-59c632ba-7453-4e05-99b8-f935dd96dca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:21.086236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1067/2110] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:20 2022] DELETE /identity/v3/projects/0165d042c889430c867227d38f523e87 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:21.091136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.091632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.091758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.111550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:21.112685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:21.169510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1044/2111] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:21.178043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.178325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.178595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.199211 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:21.200521 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:21.208882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1068/2112] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:21.212915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.222335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f16b-967e-4790-8954-7c2e17e104f8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.226746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.227333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.227636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.227904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.228539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:17:21.228833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.230409 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.241662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1045/2113] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:17:21.245754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.255296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3989bf3-1234-4f8e-b075-9952540e58aa None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.260130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.260717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.260994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.261264 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.261887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.263930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.289961 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1069/2114] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:21.294109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.304275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40355c10-3b80-4d75-89ca-03231217cd1e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.350367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:21.361690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.362237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.362515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.363343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.363998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.365910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.387158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1046/2115] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:17:21.391013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.401224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7549b3c-d925-4232-a72c-bc0387cd31de admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.405774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.406366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.406642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.406911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.407586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.409194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.419333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1070/2116] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:21.423218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.433683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44419000-8a77-43b1-9eaf-626515bd4711 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.438256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08591-371b-43ab-b220-7eeb2f9d2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.438843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08591-371b-43ab-b220-7eeb2f9d2afc admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.439153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08591-371b-43ab-b220-7eeb2f9d2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.439448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08591-371b-43ab-b220-7eeb2f9d2afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.440093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08591-371b-43ab-b220-7eeb2f9d2afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.442342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08591-371b-43ab-b220-7eeb2f9d2afc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.452749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1047/2117] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:21.456695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.466447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df2e5-6e48-45c0-afde-2c7851f638b7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.470980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.471642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.471920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.472213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] PATH_INFO: `/v3/projects/71b6519667db47988ec684c7d7dab2cc/users/8147608b576e4b8492ef4b23f793fe51/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.486286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b6519667db47988ec684c7d7dab2cc, user_id=8147608b576e4b8492ef4b23f793fe51, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.489527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.501993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1071/2118] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:21 2022] PUT /identity/v3/projects/71b6519667db47988ec684c7d7dab2cc/users/8147608b576e4b8492ef4b23f793fe51/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:21.513186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.513473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.513776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.541717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] MFA Rules not processed for user `8147608b576e4b8492ef4b23f793fe51`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:21.542958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:21.605317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1048/2119] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:21.609813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.654654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:21.672611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26102b-8b11-4132-ae4b-93414f57642e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.677748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.678343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.678620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.678920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.679675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.682214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.708275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1072/2120] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:21.712410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.723932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd735a6-3115-4063-96e3-d818294dca7c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.779009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.779655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.779938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.780212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.780850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.782792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.803727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1049/2121] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:21 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:17:21.807683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.817813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795e86-6fdc-4a16-b343-9ea1c2cd8ff4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.822464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.823057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.823338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.823643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.824283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.825884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.836224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1073/2122] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:21.840128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.850373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce2ff-5fbb-4c2e-91a3-2de28a5ed465 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.854876 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.855549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.855832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.856106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] PATH_INFO: `/v3/projects/5d194ff637f6448a9b7c3e2008f13fa0/users/5e43aca8bdbb4fc9a6600877b5116ebd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.872131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d194ff637f6448a9b7c3e2008f13fa0, user_id=5e43aca8bdbb4fc9a6600877b5116ebd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.874779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.887531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1050/2123] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:21 2022] PUT /identity/v3/projects/5d194ff637f6448a9b7c3e2008f13fa0/users/5e43aca8bdbb4fc9a6600877b5116ebd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:21.891528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.901774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f5d4e-5bd6-49a1-8f27-f4d399a540fb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.959106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ba1b-8a7b-4ccb-a61f-5b12c278c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.959750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ba1b-8a7b-4ccb-a61f-5b12c278c45f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.960027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ba1b-8a7b-4ccb-a61f-5b12c278c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.960298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ba1b-8a7b-4ccb-a61f-5b12c278c45f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.960937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8ba1b-8a7b-4ccb-a61f-5b12c278c45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.962530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8ba1b-8a7b-4ccb-a61f-5b12c278c45f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:21.972911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1074/2124] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:17:21.977060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:21.987153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2ef8-d289-4df5-af6d-631cdcde6cd4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:21.992387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:21.993035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:21.993317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:21.993586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] PATH_INFO: `/v3/projects/5d194ff637f6448a9b7c3e2008f13fa0/users/5e43aca8bdbb4fc9a6600877b5116ebd/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:21.995527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d194ff637f6448a9b7c3e2008f13fa0, user_id=5e43aca8bdbb4fc9a6600877b5116ebd, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:21.998168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:22.009286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1051/2125] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:21 2022] PUT /identity/v3/projects/5d194ff637f6448a9b7c3e2008f13fa0/users/5e43aca8bdbb4fc9a6600877b5116ebd/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:17:22.019544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:22.019832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:22.020107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:22.049021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] MFA Rules not processed for user `5e43aca8bdbb4fc9a6600877b5116ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:22.050331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:22.118198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1075/2126] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:22.129092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:22.130882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:22.145303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:22.189173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1b37-abf6-4041-810a-490b5fbdaeb7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:22.192745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f76a4d-4240-4915-b298-90dc6c2b3a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:22.193342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76a4d-4240-4915-b298-90dc6c2b3a33 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:22.193621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76a4d-4240-4915-b298-90dc6c2b3a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:22.193894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76a4d-4240-4915-b298-90dc6c2b3a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:22.202619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76a4d-4240-4915-b298-90dc6c2b3a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:22.204080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76a4d-4240-4915-b298-90dc6c2b3a33 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:22.213773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1052/2127] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:22.580596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:22.620573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:22.643143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a98582-1842-4cc0-bf8d-15ca6a4c7200 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:22.648225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:22.648846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:22.649121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:22.649393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] PATH_INFO: `/v3/users/8147608b576e4b8492ef4b23f793fe51` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:22.650505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8147608b576e4b8492ef4b23f793fe51)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:22.652461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:22.697165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8147608b576e4b8492ef4b23f793fe51'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:22.697754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8147608b576e4b8492ef4b23f793fe51'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:22.710146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8147608b576e4b8492ef4b23f793fe51'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:22.717736 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8147608b576e4b8492ef4b23f793fe51'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:22.718607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8147608b576e4b8492ef4b23f793fe51'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:22.731041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1076/2128] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:22 2022] DELETE /identity/v3/users/8147608b576e4b8492ef4b23f793fe51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:22.735583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:22.735874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:22.736150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:22.754508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:22.756270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:22.815224 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1053/2129] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:22.825400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:22.826775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:22.882060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689eb49-d4fd-4030-b791-ef7cd0b55037 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:22.885927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:22.886532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:22.886809 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:22.887687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:22.896822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:22.898240 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:22.907558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1077/2130] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:23.220009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:23.221542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:23.234578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caea30e-dcc3-4578-8708-fb6f3c43b2d0 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:23.239190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:23.240435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:23.240716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:23.240987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] PATH_INFO: `/v3/projects/71b6519667db47988ec684c7d7dab2cc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:23.242128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b6519667db47988ec684c7d7dab2cc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:23.244231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:23.293297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b6519667db47988ec684c7d7dab2cc', 'request_id': 'req-96b93bbd-cbba-46f1-8d7e-a170e00982b1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.299382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b6519667db47988ec684c7d7dab2cc', 'request_id': 'req-96b93bbd-cbba-46f1-8d7e-a170e00982b1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.307117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b6519667db47988ec684c7d7dab2cc', 'request_id': 'req-96b93bbd-cbba-46f1-8d7e-a170e00982b1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.317702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] The token cache is being invalidate because project 71b6519667db47988ec684c7d7dab2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:23.317989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.318628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.320121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1054/2131] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:23 2022] DELETE /identity/v3/projects/71b6519667db47988ec684c7d7dab2cc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:23.324075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:23.333972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778b7d-2ff1-4411-9411-2bc76df26c64 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:23.390360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:23.390981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:23.391258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:23.391559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] PATH_INFO: `/v3/users/5e43aca8bdbb4fc9a6600877b5116ebd` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:23.392669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e43aca8bdbb4fc9a6600877b5116ebd)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:23.394593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:23.398394 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:23.446442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e43aca8bdbb4fc9a6600877b5116ebd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.447070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e43aca8bdbb4fc9a6600877b5116ebd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.458670 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e43aca8bdbb4fc9a6600877b5116ebd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.465591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e43aca8bdbb4fc9a6600877b5116ebd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.466206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-fb06da26-3fbb-44c8-9c6a-d7a83cc638e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e43aca8bdbb4fc9a6600877b5116ebd'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.478450 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1078/2132] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:23 2022] DELETE /identity/v3/users/5e43aca8bdbb4fc9a6600877b5116ebd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:23.746493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:23.747940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:23.763054 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b93bbd-cbba-46f1-8d7e-a170e00982b1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:23.800034 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:23.823143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:23.823909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:23.824186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:23.824475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] PATH_INFO: `/v3/projects/5d194ff637f6448a9b7c3e2008f13fa0` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:23.825560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d194ff637f6448a9b7c3e2008f13fa0)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:23.827496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:23.872151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d194ff637f6448a9b7c3e2008f13fa0', 'request_id': 'req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.878113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d194ff637f6448a9b7c3e2008f13fa0', 'request_id': 'req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.885408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d194ff637f6448a9b7c3e2008f13fa0', 'request_id': 'req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.895767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] The token cache is being invalidate because project 5d194ff637f6448a9b7c3e2008f13fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:23.896549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.897203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c7336a4-23af-48ed-b5a5-ec91fce5d80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:23.898791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1055/2133] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:23 2022] DELETE /identity/v3/projects/5d194ff637f6448a9b7c3e2008f13fa0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:23.903726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:23.904209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:23.904371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:23.924654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:23.925878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:23.983911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1079/2134] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:23.991909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:23.992197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:23.992471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.012316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:24.013448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:24.021824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1056/2135] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:24.025872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.035230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5fdd6-145e-4696-a880-b639f46cb119 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.039887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.040472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.040748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.041018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.041664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:17:24.041956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.043566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.054717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1080/2136] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:17:24.058757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.068241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b077b-b01a-4e5d-854a-305c98b7be97 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.072780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.073355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.073630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.073897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.074513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.076454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.103253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1057/2137] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:24 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:24.107524 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.117317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462f51-5a73-4b54-8a03-b888f33a5e3e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.172217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.172813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.173182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.173404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.174036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.175980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.187260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:24.203302 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1081/2138] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:24 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:24.204543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.214558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4d448-5a8e-43d6-950a-9cd7751482e3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.219084 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.219700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.219972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.220237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.220870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.222444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.232942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1058/2139] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:24.236744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.247057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86157-8c3d-4609-86a2-3888d9c1a8d0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.251635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6def5d-7305-4680-9fc4-d4041f840ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.252217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6def5d-7305-4680-9fc4-d4041f840ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.252490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6def5d-7305-4680-9fc4-d4041f840ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.252759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6def5d-7305-4680-9fc4-d4041f840ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.253391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6def5d-7305-4680-9fc4-d4041f840ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.254956 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6def5d-7305-4680-9fc4-d4041f840ed5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.265516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1082/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:24.269444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.279336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e4ee2-84f4-4853-b555-c592f93c7d03 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.283995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.284630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.284910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.285186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] PATH_INFO: `/v3/projects/231b912bb03647fab26f94c0ce0d7df7/users/9c1849593cda48829082fe46603f5841/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.300444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=231b912bb03647fab26f94c0ce0d7df7, user_id=9c1849593cda48829082fe46603f5841, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.303770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.317301 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1059/2141] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:24 2022] PUT /identity/v3/projects/231b912bb03647fab26f94c0ce0d7df7/users/9c1849593cda48829082fe46603f5841/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:24.327861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02366-f10c-4f6a-8e39-ec19ece65e31 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.328198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02366-f10c-4f6a-8e39-ec19ece65e31 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.328480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02366-f10c-4f6a-8e39-ec19ece65e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.359538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-5dd02366-f10c-4f6a-8e39-ec19ece65e31 None None] MFA Rules not processed for user `9c1849593cda48829082fe46603f5841`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:24.360758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5dd02366-f10c-4f6a-8e39-ec19ece65e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:24.429045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1083/2142] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:24.440302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:24.441885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:24.498549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e33ed-f6ee-4ddb-9245-d71ff25c2eaf admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:24.502207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:24.502800 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:24.503079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:24.503351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:24.511786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:24.513210 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:24.522325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1060/2143] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:17:34.426008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=39 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:34.517841 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:37.363449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:37.363938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:37.364021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:37.386673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:37.387989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:37.448017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1084/2144] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:37.498599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:37.500086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:37.572739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e8b5-7d4c-4b5a-bdbb-9711ba9187ca service glance] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:37.581513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791e0e9-f34f-4736-8082-5b9dd22716dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:37.582122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e0e9-f34f-4736-8082-5b9dd22716dc service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:37.582405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e0e9-f34f-4736-8082-5b9dd22716dc service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:37.582701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e0e9-f34f-4736-8082-5b9dd22716dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:37.593173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e0e9-f34f-4736-8082-5b9dd22716dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:37.594799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e0e9-f34f-4736-8082-5b9dd22716dc service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:37.606004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1061/2145] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:17:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:17:45.441294 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:45.523496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222e70f-a058-4f7f-8822-59c4c03d4d2f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:45.529715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:45.530423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:45.530839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:45.531154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] PATH_INFO: `/v3/users/9c1849593cda48829082fe46603f5841` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:45.533019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1849593cda48829082fe46603f5841)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:45.535443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:45.592073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1849593cda48829082fe46603f5841'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:45.593043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1849593cda48829082fe46603f5841'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:45.609288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1849593cda48829082fe46603f5841'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:45.620340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1849593cda48829082fe46603f5841'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:45.621758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1849593cda48829082fe46603f5841'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:45.635828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1085/2146] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:17:45 2022] DELETE /identity/v3/users/9c1849593cda48829082fe46603f5841 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:45.640502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:45.641156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:45.641156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:45.659692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:45.660903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:45.719972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1062/2147] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:45.730538 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:45.732073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:45.760423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:45.790904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86572ea-1563-49e5-a917-91f77b4f0b1c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:45.794523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536841-b28e-43e1-9ec8-3800b10c6e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:45.795118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536841-b28e-43e1-9ec8-3800b10c6e4d service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:45.795389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536841-b28e-43e1-9ec8-3800b10c6e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:45.795687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536841-b28e-43e1-9ec8-3800b10c6e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:45.805021 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536841-b28e-43e1-9ec8-3800b10c6e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:45.806440 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536841-b28e-43e1-9ec8-3800b10c6e4d service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:45.816056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1086/2148] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:46.167580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.169419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:46.182277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15932-a67c-4320-9e48-923c09d308eb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.198630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.199819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.200092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.200367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] PATH_INFO: `/v3/projects/231b912bb03647fab26f94c0ce0d7df7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.201580 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231b912bb03647fab26f94c0ce0d7df7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.203568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.260145 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231b912bb03647fab26f94c0ce0d7df7', 'request_id': 'req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:46.268478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231b912bb03647fab26f94c0ce0d7df7', 'request_id': 'req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:46.278731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231b912bb03647fab26f94c0ce0d7df7', 'request_id': 'req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:46.292830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] The token cache is being invalidate because project 231b912bb03647fab26f94c0ce0d7df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:17:46.293204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:46.293861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-cd2fd0f2-7ea1-4501-8f7a-2173247f3241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:17:46.295633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1063/2149] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:17:46 2022] DELETE /identity/v3/projects/231b912bb03647fab26f94c0ce0d7df7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:46.300777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.301435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.302013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.325174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:46.326435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:46.392480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1087/2150] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:46.458035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.458258 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.458507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.483115 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:46.484496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:46.493718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1064/2151] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:46.498061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.508672 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10c57d-85b8-4019-916f-9e730dc6aedd None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.513723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.514315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.514587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.514852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.515531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:17:46.515828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.517452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.529992 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1088/2152] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:17:46.534187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.545101 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8115083-d116-47b5-8776-eed92ec1a4b8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.550827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.551454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.551735 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.552009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.552645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.555126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.559829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:46.585330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1065/2153] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:17:46 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:17:46.589497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.600586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b9bf8-f2e7-4a75-802e-902fb5f30243 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.661971 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.663106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.663380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.663722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.664363 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.666332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.690540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1089/2154] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:17:46 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:17:46.694653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.706944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a4d0-b52a-42ca-bf1e-bbbbb8f14fd5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.716216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.716216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.716216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.716216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.716617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.716617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.731137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1066/2155] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:46.731608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.743164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbd232-70f7-49d3-aa7f-62fbbd77ef07 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.748118 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea405-edb4-4cd1-a6e6-a7b8b9cc568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.748748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea405-edb4-4cd1-a6e6-a7b8b9cc568f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.749023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea405-edb4-4cd1-a6e6-a7b8b9cc568f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.749907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea405-edb4-4cd1-a6e6-a7b8b9cc568f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.750602 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ea405-edb4-4cd1-a6e6-a7b8b9cc568f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.752230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ea405-edb4-4cd1-a6e6-a7b8b9cc568f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.764773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1090/2156] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:17:46.768881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.780899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e985c-4fb5-49af-8509-3c576e0f6eda admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:46.785854 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:46.786522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.786796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.787123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] PATH_INFO: `/v3/projects/958fcfe92c5641a6b8fdd9447e07d3c8/users/7f44c3cefaa44119a1695fe4c4646b00/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.803987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958fcfe92c5641a6b8fdd9447e07d3c8, user_id=7f44c3cefaa44119a1695fe4c4646b00, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:46.806767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:46.821016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1067/2157] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:17:46 2022] PUT /identity/v3/projects/958fcfe92c5641a6b8fdd9447e07d3c8/users/7f44c3cefaa44119a1695fe4c4646b00/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:17:46.831972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c522ba7-ec50-4e3a-97ec-bc931b1975a4 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:46.832245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c522ba7-ec50-4e3a-97ec-bc931b1975a4 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:46.832519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c522ba7-ec50-4e3a-97ec-bc931b1975a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:46.863695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3c522ba7-ec50-4e3a-97ec-bc931b1975a4 None None] MFA Rules not processed for user `7f44c3cefaa44119a1695fe4c4646b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:46.864923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3c522ba7-ec50-4e3a-97ec-bc931b1975a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:46.887214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:46.943548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1091/2158] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:46.954773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:46.956511 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:47.018297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f79d-8e44-4545-a48a-d6edfb959a97 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:47.022609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:47.023218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:47.023527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:47.023796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:47.032669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:47.035844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:47.057164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1068/2159] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:17:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:17:55.799722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:55.800238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:55.800238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:55.821041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:17:55.822236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:55.880583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1092/2160] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 13:17:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:17:55.893496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:17:55.895088 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:17:55.968736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cefed-f315-4ec2-b2b3-3755664d3b62 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:17:55.973704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490bb72-0cf9-48a0-946e-8e59a8c588cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:17:55.974304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490bb72-0cf9-48a0-946e-8e59a8c588cc service swift] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:17:55.974587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490bb72-0cf9-48a0-946e-8e59a8c588cc service swift] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:17:55.974856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490bb72-0cf9-48a0-946e-8e59a8c588cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:17:55.983752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490bb72-0cf9-48a0-946e-8e59a8c588cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:17:55.985337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490bb72-0cf9-48a0-946e-8e59a8c588cc service swift] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:17:55.993708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1069/2161] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:18:00.934830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:01.048184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0d4b-b922-4e2e-a985-05ea18804981 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:01.053279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:01.054762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:01.055204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:01.055727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] PATH_INFO: `/v3/users/7f44c3cefaa44119a1695fe4c4646b00` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:01.057236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f44c3cefaa44119a1695fe4c4646b00)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:01.059626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:01.091230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:01.111836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f44c3cefaa44119a1695fe4c4646b00'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.112506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f44c3cefaa44119a1695fe4c4646b00'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.142902 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f44c3cefaa44119a1695fe4c4646b00'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.151593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f44c3cefaa44119a1695fe4c4646b00'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.152213 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f44c3cefaa44119a1695fe4c4646b00'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.165702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1093/2162] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:00 2022] DELETE /identity/v3/users/7f44c3cefaa44119a1695fe4c4646b00 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:01.170403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:01.170896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:01.171711 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:01.234324 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:01.235910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:01.246209 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:01.327441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1070/2163] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:01.337028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:01.338664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:01.421369 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c1b14-0802-48ec-9f78-b864a78569eb admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:01.424921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c4e1e-2839-4f39-9665-c38c1b36c131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:01.425517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4e1e-2839-4f39-9665-c38c1b36c131 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:01.425792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4e1e-2839-4f39-9665-c38c1b36c131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:01.426058 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4e1e-2839-4f39-9665-c38c1b36c131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:01.434783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c4e1e-2839-4f39-9665-c38c1b36c131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:01.436321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c4e1e-2839-4f39-9665-c38c1b36c131 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:01.446934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1094/2164] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:01.732366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:01.733982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:01.750240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410928-bde4-4b9a-abd6-aedd73598d76 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:01.756761 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:01.758014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:01.758327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:01.758575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] PATH_INFO: `/v3/projects/958fcfe92c5641a6b8fdd9447e07d3c8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:01.759819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] RBAC: Authorizing `identity:delete_project(project_id=958fcfe92c5641a6b8fdd9447e07d3c8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:01.762596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:01.818362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958fcfe92c5641a6b8fdd9447e07d3c8', 'request_id': 'req-7a705bcf-fd82-4424-81dd-f6a7b396789c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.825547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958fcfe92c5641a6b8fdd9447e07d3c8', 'request_id': 'req-7a705bcf-fd82-4424-81dd-f6a7b396789c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.833866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958fcfe92c5641a6b8fdd9447e07d3c8', 'request_id': 'req-7a705bcf-fd82-4424-81dd-f6a7b396789c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.847738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] The token cache is being invalidate because project 958fcfe92c5641a6b8fdd9447e07d3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:01.848019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.848738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7a705bcf-fd82-4424-81dd-f6a7b396789c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:01.850630 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1071/2165] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:01 2022] DELETE /identity/v3/projects/958fcfe92c5641a6b8fdd9447e07d3c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:01.856878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:01.857501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:01.857695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:01.906806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:01.908128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:01.969086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1095/2166] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:01.977957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:01.978247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:01.978522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:01.999877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:02.001140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:02.013479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1072/2167] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:02.015017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.026078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565de8d-6e0f-47d1-9d33-883bf83c82e2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.030844 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.031509 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.031790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.032064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.032714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:18:02.033042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.034708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.037523 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:02.050987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1096/2168] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:18:02.052673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.062278 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd257fa7-7708-4998-bb73-39f7d0461952 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.067183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.067821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.068107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.068382 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.069055 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.071648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.105063 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1073/2169] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:02 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:02.106113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.117171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b48f6-08c6-473f-8b99-9298f6b3e131 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.176443 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.177125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.177405 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.177680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.178338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.181471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.204093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1097/2170] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:02 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:18:02.208221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.218669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58dbca-fbba-4ea2-a6e5-64e68aca06db admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.223936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.224567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.224847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.225407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.226471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.228327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.239954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1074/2171] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:02.247787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.259110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe217c9-ae3d-4c02-b6c1-0c2f59c93ee8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.265052 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c94b99-4f6c-44a1-9daf-0b896567d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.265663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c94b99-4f6c-44a1-9daf-0b896567d795 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.265936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c94b99-4f6c-44a1-9daf-0b896567d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.266237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c94b99-4f6c-44a1-9daf-0b896567d795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.266882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c94b99-4f6c-44a1-9daf-0b896567d795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.268517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c94b99-4f6c-44a1-9daf-0b896567d795 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.279873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1098/2172] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:02.284262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.295342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d8cf-fab5-4667-84ae-9c0138919761 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.300143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.300811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.301093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.301537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] PATH_INFO: `/v3/projects/edbbe9084ac74bd58a37cf110c335d08/users/655074e1eb1c4b6d9e908aad856b6bdb/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.317593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbbe9084ac74bd58a37cf110c335d08, user_id=655074e1eb1c4b6d9e908aad856b6bdb, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.320362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.335830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1075/2173] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:02 2022] PUT /identity/v3/projects/edbbe9084ac74bd58a37cf110c335d08/users/655074e1eb1c4b6d9e908aad856b6bdb/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:18:02.346397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.346683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.346953 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.378769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] MFA Rules not processed for user `655074e1eb1c4b6d9e908aad856b6bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:02.383858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:02.482212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1099/2174] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:02.495772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:02.497398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:02.552259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:02.580137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dbf02-bd7c-475b-9c8e-e13462ce9187 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:02.584221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc146f14-1086-40b2-97d2-ffa86399e675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:02.584964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc146f14-1086-40b2-97d2-ffa86399e675 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:02.586048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc146f14-1086-40b2-97d2-ffa86399e675 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:02.586421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc146f14-1086-40b2-97d2-ffa86399e675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:02.607285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc146f14-1086-40b2-97d2-ffa86399e675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:02.609197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc146f14-1086-40b2-97d2-ffa86399e675 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:02.620501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1076/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:12.472242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:12.615386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=10 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:12.746833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:12.806750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14a064-0c0f-43c8-a2c4-ec187eb71524 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:12.811839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:12.812462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:12.812740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:12.813010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] PATH_INFO: `/v3/users/655074e1eb1c4b6d9e908aad856b6bdb` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:12.814113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=655074e1eb1c4b6d9e908aad856b6bdb)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:12.816065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:12.862458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655074e1eb1c4b6d9e908aad856b6bdb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:12.863056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655074e1eb1c4b6d9e908aad856b6bdb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:12.875962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655074e1eb1c4b6d9e908aad856b6bdb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:12.883023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655074e1eb1c4b6d9e908aad856b6bdb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:12.883658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655074e1eb1c4b6d9e908aad856b6bdb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:12.896044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1100/2176] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:12 2022] DELETE /identity/v3/users/655074e1eb1c4b6d9e908aad856b6bdb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:12.900500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:12.900786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:12.901059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:12.921207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:12.922419 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:12.981236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1077/2177] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:12.990790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:12.992214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:13.022392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:13.023796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:13.051864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2cd0-f5d1-44f5-8afb-c8788e659b6b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:13.055500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:13.056114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:13.056391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:13.056660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:13.065740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:13.067179 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:13.076568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1101/2178] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:13.116838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bad375-e285-45ba-84d1-eca3d504ac0d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:13.123756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:13.124369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:13.125078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:13.125357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:13.127796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:13.142030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:13.143763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9da80-ecd1-4f71-be54-3132c194c548 service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:13.155513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1078/2179] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:18:13.468254 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:13.469778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:13.485905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f999d8-2ca3-4263-8b13-c3db13db798b service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:13.491879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:13.492650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:13.493005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:13.493348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] PATH_INFO: `/v3/projects/edbbe9084ac74bd58a37cf110c335d08` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:13.494916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbbe9084ac74bd58a37cf110c335d08)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:13.497876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:13.519316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:13.555014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbbe9084ac74bd58a37cf110c335d08', 'request_id': 'req-30f2fd43-1273-46f0-b79d-88d0b23af19e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:13.566329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbbe9084ac74bd58a37cf110c335d08', 'request_id': 'req-30f2fd43-1273-46f0-b79d-88d0b23af19e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:13.575348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbbe9084ac74bd58a37cf110c335d08', 'request_id': 'req-30f2fd43-1273-46f0-b79d-88d0b23af19e'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:13.586125 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] The token cache is being invalidate because project edbbe9084ac74bd58a37cf110c335d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:13.586418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:13.587071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:13.588662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1102/2180] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:13 2022] DELETE /identity/v3/projects/edbbe9084ac74bd58a37cf110c335d08 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:18.485250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eba0fa-b4a3-44f0-8dee-9a54e3c844a0 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:18.486106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eba0fa-b4a3-44f0-8dee-9a54e3c844a0 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:18.486598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eba0fa-b4a3-44f0-8dee-9a54e3c844a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:18.518035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d2eba0fa-b4a3-44f0-8dee-9a54e3c844a0 None None] MFA Rules not processed for user `374c419c61e34718b350e06e35764fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:18.519175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d2eba0fa-b4a3-44f0-8dee-9a54e3c844a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:18.572777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=100 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:18.581259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1079/2181] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 13:18:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:18.593593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:18.594987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:18.665773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2fd43-1273-46f0-b79d-88d0b23af19e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:18.671292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bb121942c94956b40024757f89a5c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:18.671938 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:18.672215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:18.672480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:18.680244 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:18.681832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:18.690288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1103/2182] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 13:18:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 13:18:28.687082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:32.405902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:32.406496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:32.406623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:32.429066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] MFA Rules not processed for user `0b9ef1203b0b4af39dd66b252eace4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:32.430682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:32.490693 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1080/2183] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:18:37.229193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:37.230630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:37.309588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47631-5392-4191-bd3b-e2f052bf9008 service swift] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:37.313180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:37.313770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:37.314043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:37.314310 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:37.315999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:37.377321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:37.378738 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:37.388229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1104/2184] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:40.709446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:40.711065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:40.736014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9d2fb-58bb-49b3-b2ce-8e4ddb7b0383 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:40.747895 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:40.748972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:40.749362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:40.750257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] PATH_INFO: `/v3/users/506adca00a91411e83a369c937538ee5` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:40.752340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506adca00a91411e83a369c937538ee5)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:40.755356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:40.803225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506adca00a91411e83a369c937538ee5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:40.810879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506adca00a91411e83a369c937538ee5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:40.822959 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506adca00a91411e83a369c937538ee5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:40.823809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506adca00a91411e83a369c937538ee5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:40.831024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0be73005-3711-4ffb-9f0a-fb5793520739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506adca00a91411e83a369c937538ee5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:40.836965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1081/2185] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:40 2022] DELETE /identity/v3/users/506adca00a91411e83a369c937538ee5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:41.021970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.040140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823e6f7-afd7-4bb9-9edf-b8b55b219dcf service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.109174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.110089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.110518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.110887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] PATH_INFO: `/v3/projects/286b1cf90c5344faa0049a1eed43128a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.112425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286b1cf90c5344faa0049a1eed43128a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.115567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.158708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:41.171348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286b1cf90c5344faa0049a1eed43128a', 'request_id': 'req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:41.177452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286b1cf90c5344faa0049a1eed43128a', 'request_id': 'req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:41.185073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286b1cf90c5344faa0049a1eed43128a', 'request_id': 'req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:41.195722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] The token cache is being invalidate because project 286b1cf90c5344faa0049a1eed43128a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:41.196212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:41.196977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6a1e5a58-9706-45ac-bd42-d2bca790cfa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:41.198548 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1105/2186] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:41 2022] DELETE /identity/v3/projects/286b1cf90c5344faa0049a1eed43128a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:41.204207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.204572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.204886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.224935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:41.226143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:41.283845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1082/2187] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:18:41.292111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.292409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.292690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.312171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:41.313388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:41.321309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1106/2188] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:41.326032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.335649 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c868e-e054-4d4f-a703-82923515a2ff None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.340997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.341632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.341915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.342188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.342971 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:18:41.343266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.345247 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.358082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1083/2189] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:18:41.362341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.371543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5b7b3-8a87-4d52-bdfb-b8406ded81be None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.376183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.376773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.377050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.377321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.377958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.379896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.407430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1107/2190] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:41 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:18:41.411471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.417668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:41.421504 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aca000-79ef-4e6b-952a-21ab40fbe6a8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.479831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.480429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.480709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.480982 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.481617 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.483554 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.504231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1084/2191] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:41 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:18:41.508676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.519691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d73252-c01a-4f21-beaa-8e3751e31eef admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.524242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.524831 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.525109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.525382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.526022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.527715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.537347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1108/2192] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:41.541086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.552819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364cf3c-500d-4eca-8c50-82d22878e7c9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.557477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153f107-283d-4756-b599-496e0403c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.558119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f107-283d-4756-b599-496e0403c5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.558396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f107-283d-4756-b599-496e0403c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.559206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f107-283d-4756-b599-496e0403c5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.559894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153f107-283d-4756-b599-496e0403c5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.561477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153f107-283d-4756-b599-496e0403c5d9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.571908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1085/2193] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:41.576580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.586532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711e09-52a3-4dde-8325-b935acf0eafd admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.591193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.591869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.592155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.592431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] PATH_INFO: `/v3/projects/9c67fefd12734c57b22cae01a13de65c/users/a8603114a1934259b290b59d9378410d/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.606604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c67fefd12734c57b22cae01a13de65c, user_id=a8603114a1934259b290b59d9378410d, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.609306 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.622060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1109/2194] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:41 2022] PUT /identity/v3/projects/9c67fefd12734c57b22cae01a13de65c/users/a8603114a1934259b290b59d9378410d/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:41.627234 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168f57-0d47-41b5-bc7c-d5265172fca5 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.627555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168f57-0d47-41b5-bc7c-d5265172fca5 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.627833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168f57-0d47-41b5-bc7c-d5265172fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.648391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ee168f57-0d47-41b5-bc7c-d5265172fca5 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:41.649576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ee168f57-0d47-41b5-bc7c-d5265172fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:41.707163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1086/2195] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:41.717259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:41.719002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:41.775948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7cb1-bfb0-4e2f-8576-b238cb9e99d0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:41.779719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:41.780316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:41.780595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:41.780867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:41.789759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:41.791133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:41.800611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1110/2196] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:42.422430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.422953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.422953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.450222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] MFA Rules not processed for user `a8603114a1934259b290b59d9378410d`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:42.451447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:42.517560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1087/2197] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:18:42.522278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:42.534250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377247c-5628-4891-b465-12b161a71a68 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:42.538490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:42.539228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.539765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.540715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.542560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:42.543775 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:42.587121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1111/2198] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:42 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:18:42.592195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:42.604634 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85f48-8f24-4ba0-8342-90a76b135bc8 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:42.616517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:42.677459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:42.678157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.678516 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.678975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.679658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:42.681611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:42.707489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1088/2199] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:42 2022] POST /identity/v3/users => generated 309 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:42.711715 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:42.724939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063057b-f89e-4ea6-9f7e-0234a9ce9040 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:42.730519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:42.731117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.731426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.731701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.732360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:42.733948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:42.746047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1112/2200] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:42.750412 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:42.760736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56591dd9-1484-4f0a-9f96-2d6fac495ec3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:42.766427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:42.767095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.767374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.767680 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] PATH_INFO: `/v3/projects/10dfa8c6adb94dbcbac9fb9319b096e3/users/ef89ea3c98d145d98669f9fea2ed0fbe/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.783853 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10dfa8c6adb94dbcbac9fb9319b096e3, user_id=ef89ea3c98d145d98669f9fea2ed0fbe, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:42.786605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:42.800005 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1089/2201] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:42 2022] PUT /identity/v3/projects/10dfa8c6adb94dbcbac9fb9319b096e3/users/ef89ea3c98d145d98669f9fea2ed0fbe/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:42.804114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:42.814588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bfb66-5026-4fff-bce1-eebe817c0fb1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:42.839612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:42.875737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa592e5e-41cb-4a08-9e49-fe1f3a8f03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:42.876345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa592e5e-41cb-4a08-9e49-fe1f3a8f03a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.876620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa592e5e-41cb-4a08-9e49-fe1f3a8f03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.876888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa592e5e-41cb-4a08-9e49-fe1f3a8f03a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.877568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa592e5e-41cb-4a08-9e49-fe1f3a8f03a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:42.879155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa592e5e-41cb-4a08-9e49-fe1f3a8f03a8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:42.889166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1113/2202] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:42.893638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:42.904623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa999ec-6b5b-47a8-b998-465c355a8b6d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:42.909292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:42.910047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:42.910302 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:42.910626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] PATH_INFO: `/v3/projects/10dfa8c6adb94dbcbac9fb9319b096e3/users/ef89ea3c98d145d98669f9fea2ed0fbe/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:42.912623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10dfa8c6adb94dbcbac9fb9319b096e3, user_id=ef89ea3c98d145d98669f9fea2ed0fbe, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:42.915274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:42.925548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1090/2203] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:42 2022] PUT /identity/v3/projects/10dfa8c6adb94dbcbac9fb9319b096e3/users/ef89ea3c98d145d98669f9fea2ed0fbe/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:43.563475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:43.564006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:43.564235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:43.593296 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] MFA Rules not processed for user `ef89ea3c98d145d98669f9fea2ed0fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:43.594572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:43.665564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1114/2204] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:44.338406 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:44.340700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:44.419612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d610eb-f21f-48bf-b48e-847920451880 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:44.424726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:44.425335 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:44.425616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:44.425894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:44.427655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:44.439744 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:44.441331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:44.451706 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1091/2205] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:44.967434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:45.032278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353cad0-cca4-42b3-9829-ae5f0d0d9fc5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:45.036810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:45.037445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:45.037728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:45.038005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] PATH_INFO: `/v3/users/a8603114a1934259b290b59d9378410d` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:45.039160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8603114a1934259b290b59d9378410d)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:45.041126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:45.089377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8603114a1934259b290b59d9378410d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.090082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8603114a1934259b290b59d9378410d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.091981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:45.103419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8603114a1934259b290b59d9378410d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.111309 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8603114a1934259b290b59d9378410d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.111970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8603114a1934259b290b59d9378410d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.125209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1115/2206] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:44 2022] DELETE /identity/v3/users/a8603114a1934259b290b59d9378410d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:45.301121 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:45.314487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667642c2-4edf-48d7-a7bd-c76d9b20cb0b service placement] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:45.368615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:45.376768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:45.377423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:45.377931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:45.378217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] PATH_INFO: `/v3/projects/9c67fefd12734c57b22cae01a13de65c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:45.379562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c67fefd12734c57b22cae01a13de65c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:45.381499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:45.429847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c67fefd12734c57b22cae01a13de65c', 'request_id': 'req-1c7d5297-1368-4152-bc9a-278509904075'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.436135 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c67fefd12734c57b22cae01a13de65c', 'request_id': 'req-1c7d5297-1368-4152-bc9a-278509904075'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.443804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c67fefd12734c57b22cae01a13de65c', 'request_id': 'req-1c7d5297-1368-4152-bc9a-278509904075'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.456245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] The token cache is being invalidate because project 9c67fefd12734c57b22cae01a13de65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:45.456530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.457183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.458689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1092/2207] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:45 2022] DELETE /identity/v3/projects/9c67fefd12734c57b22cae01a13de65c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:45.462756 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:45.464198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:45.477713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7acc0-876d-483c-bf7c-4f2dbd6407a5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:45.536167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:45.536801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:45.537080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:45.537355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] PATH_INFO: `/v3/users/ef89ea3c98d145d98669f9fea2ed0fbe` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:45.538513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef89ea3c98d145d98669f9fea2ed0fbe)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:45.540482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:45.588762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef89ea3c98d145d98669f9fea2ed0fbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.589490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef89ea3c98d145d98669f9fea2ed0fbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.604390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef89ea3c98d145d98669f9fea2ed0fbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.617010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef89ea3c98d145d98669f9fea2ed0fbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.617761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-ded88c80-8d8b-4f72-ae64-0fb5d5e4065b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef89ea3c98d145d98669f9fea2ed0fbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.632346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1116/2208] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:45 2022] DELETE /identity/v3/users/ef89ea3c98d145d98669f9fea2ed0fbe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:45.813475 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:45.815057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:45.834472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5297-1368-4152-bc9a-278509904075 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:45.917625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:45.918303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:45.918718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:45.918842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] PATH_INFO: `/v3/projects/10dfa8c6adb94dbcbac9fb9319b096e3` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:45.920007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=10dfa8c6adb94dbcbac9fb9319b096e3)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:45.921943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:45.974921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10dfa8c6adb94dbcbac9fb9319b096e3', 'request_id': 'req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.981805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10dfa8c6adb94dbcbac9fb9319b096e3', 'request_id': 'req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:45.990763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10dfa8c6adb94dbcbac9fb9319b096e3', 'request_id': 'req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:46.002970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] The token cache is being invalidate because project 10dfa8c6adb94dbcbac9fb9319b096e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:46.003339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:46.004073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7064fe3d-5a40-4e0e-b7c3-880bff0649bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:46.005860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1093/2209] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:45 2022] DELETE /identity/v3/projects/10dfa8c6adb94dbcbac9fb9319b096e3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:46.010557 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.011074 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.011303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.033150 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:46.034625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:46.079535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:46.102701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1117/2210] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:46.111392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.111788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.112079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.136993 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:46.138688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:46.149351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1094/2211] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:46.153540 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.164935 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ac4b4-7177-4002-96b7-5c36c8d80317 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.170547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.171239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.171612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.171965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.172933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:18:46.173303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.174994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.188613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1118/2212] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:18:46.192947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.205981 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14acd6d-b5dc-4d90-9bb2-e0d41523b1f2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.210763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.211438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.211723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.212100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.212766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.214663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.222093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:46.251131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1095/2213] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:18:46.252317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.263040 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6359b31-ba5a-4307-bd41-ce748aa747ed admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.326041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.326681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.326934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.327214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.327890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.329835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.356185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1119/2214] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:46.357578 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.368131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84da89-ac6b-4b87-9404-c39cab1fcbef admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.373591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.374305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.374712 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.375081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.375910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.377639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.388395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1096/2215] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:46.392772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.403482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1bcb-a0df-447f-a05c-d64ac8a8eed5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.411903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1779c2-ec55-42e3-99ef-9ac90b198e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.412659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1779c2-ec55-42e3-99ef-9ac90b198e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.413039 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1779c2-ec55-42e3-99ef-9ac90b198e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.413457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1779c2-ec55-42e3-99ef-9ac90b198e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.414218 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1779c2-ec55-42e3-99ef-9ac90b198e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.415977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1779c2-ec55-42e3-99ef-9ac90b198e96 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.428982 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1120/2216] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:46.433252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.445383 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911136fa-0058-410c-910a-519facf66a19 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.450130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.450795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.451077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.451369 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] PATH_INFO: `/v3/projects/f0a348ad52f146f6853c3ea6e2dd79a6/users/8281082ec52641b39b74591a33466126/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.467125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a348ad52f146f6853c3ea6e2dd79a6, user_id=8281082ec52641b39b74591a33466126, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.469966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.483734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1097/2217] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:46 2022] PUT /identity/v3/projects/f0a348ad52f146f6853c3ea6e2dd79a6/users/8281082ec52641b39b74591a33466126/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:46.495084 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.495476 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.495827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.524044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] MFA Rules not processed for user `8281082ec52641b39b74591a33466126`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:46.525278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:46.592566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1121/2218] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:46.597104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.662775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3bd2-15fa-4572-92f0-79444ea50170 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.667668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.668847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.669139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.669452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.670127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.672157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.703726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1098/2219] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:46.705505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.721988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1763d5-9ebd-4db9-8ba7-624fc7bbd51b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.782493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:46.802224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.802845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.803124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.803418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.804065 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.806012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.832204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1122/2220] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:46 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:46.836274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.847238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36dead-eb35-400f-a4e8-15b48efcaf5d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.851928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.852526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.852809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.853081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.853725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.855322 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.865996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1099/2221] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:46.870425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.880534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374cefa-3b64-47dd-984d-49ed98025e67 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.885471 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.886248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.886707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.887510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] PATH_INFO: `/v3/projects/6f42ec16ff89408c8f3981358d59769a/users/6c29f7b757ad47f2a72c407e9d380920/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.903918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f42ec16ff89408c8f3981358d59769a, user_id=6c29f7b757ad47f2a72c407e9d380920, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.906573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:46.920865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1123/2222] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:46 2022] PUT /identity/v3/projects/6f42ec16ff89408c8f3981358d59769a/users/6c29f7b757ad47f2a72c407e9d380920/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:46.924825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:46.934860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea234-7fc3-4b78-b897-e81b1f9330d4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:46.989718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ff225-a3c4-4a37-802c-7c71c45b3646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:46.990315 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ff225-a3c4-4a37-802c-7c71c45b3646 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:46.990599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ff225-a3c4-4a37-802c-7c71c45b3646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:46.990874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ff225-a3c4-4a37-802c-7c71c45b3646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:46.991609 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ff225-a3c4-4a37-802c-7c71c45b3646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:46.993219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ff225-a3c4-4a37-802c-7c71c45b3646 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:47.002593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1100/2223] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:47.006701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:47.017708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617a688-981b-4ec7-88d5-23521be4da41 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:47.022279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:47.022921 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:47.023195 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:47.023533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] PATH_INFO: `/v3/projects/6f42ec16ff89408c8f3981358d59769a/users/6c29f7b757ad47f2a72c407e9d380920/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:47.025693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f42ec16ff89408c8f3981358d59769a, user_id=6c29f7b757ad47f2a72c407e9d380920, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:47.028969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:47.038925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1124/2224] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:47 2022] PUT /identity/v3/projects/6f42ec16ff89408c8f3981358d59769a/users/6c29f7b757ad47f2a72c407e9d380920/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:47.049016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:47.049303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:47.049579 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:47.076934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] MFA Rules not processed for user `6c29f7b757ad47f2a72c407e9d380920`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:47.078129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:47.087032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:47.147248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1101/2225] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:47.158740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:47.160392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:47.237490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601cfc0-8a9c-4d89-9b90-fef105be0f5e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:47.241162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae02-27ae-46b9-a5fe-83f0f1833958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:47.241759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae02-27ae-46b9-a5fe-83f0f1833958 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:47.242036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae02-27ae-46b9-a5fe-83f0f1833958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:47.242307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae02-27ae-46b9-a5fe-83f0f1833958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:47.251858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ae02-27ae-46b9-a5fe-83f0f1833958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:47.253284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ae02-27ae-46b9-a5fe-83f0f1833958 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:47.263393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1125/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:47.672483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:47.734642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e010012-4a4e-4b8e-a883-c3a31194c36f None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:47.739484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:47.740148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:47.740433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:47.740710 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] PATH_INFO: `/v3/users/8281082ec52641b39b74591a33466126` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:47.741843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8281082ec52641b39b74591a33466126)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:47.743824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:47.789586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8281082ec52641b39b74591a33466126'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:47.796869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8281082ec52641b39b74591a33466126'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:47.808524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8281082ec52641b39b74591a33466126'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:47.809736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8281082ec52641b39b74591a33466126'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:47.818328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8281082ec52641b39b74591a33466126'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:47.824447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1102/2227] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:47 2022] DELETE /identity/v3/users/8281082ec52641b39b74591a33466126 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:18:47.829317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:47.829606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:47.829885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:47.848385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:47.849594 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:47.907932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1126/2228] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:47.917615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:47.919517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:47.949848 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:47.977729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354d41-c2e7-4d1e-8160-46cdcf0294fd admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:47.981949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:47.982551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:47.982832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:47.983105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:47.992040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:47.993467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:48.002817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1103/2229] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:48.267854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:48.269432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:48.282735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fd916-1ef9-4ac8-9361-7bfaf3b07196 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:48.287789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:48.288494 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:48.288856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:48.289246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] PATH_INFO: `/v3/projects/f0a348ad52f146f6853c3ea6e2dd79a6` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:48.290356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a348ad52f146f6853c3ea6e2dd79a6)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:48.292393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:48.306502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:48.343005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a348ad52f146f6853c3ea6e2dd79a6', 'request_id': 'req-a0d8e7aa-b4af-482c-a375-b271dd1937b3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.349210 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a348ad52f146f6853c3ea6e2dd79a6', 'request_id': 'req-a0d8e7aa-b4af-482c-a375-b271dd1937b3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.356795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a348ad52f146f6853c3ea6e2dd79a6', 'request_id': 'req-a0d8e7aa-b4af-482c-a375-b271dd1937b3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.367087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] The token cache is being invalidate because project f0a348ad52f146f6853c3ea6e2dd79a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:48.367377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.368049 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.369526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1127/2230] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:48 2022] DELETE /identity/v3/projects/f0a348ad52f146f6853c3ea6e2dd79a6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:48.373531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:48.383097 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c875c1-5493-4ef2-a7b0-85facb98fa3a service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:48.439389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:48.440030 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:48.440311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:48.440582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] PATH_INFO: `/v3/users/6c29f7b757ad47f2a72c407e9d380920` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:48.441690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c29f7b757ad47f2a72c407e9d380920)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:48.443705 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:48.492111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c29f7b757ad47f2a72c407e9d380920'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.499491 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c29f7b757ad47f2a72c407e9d380920'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.511639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c29f7b757ad47f2a72c407e9d380920'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.512838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c29f7b757ad47f2a72c407e9d380920'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.519646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71ca025f-a81e-444a-b360-00a8161ef17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c29f7b757ad47f2a72c407e9d380920'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.525697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1104/2231] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:18:48 2022] DELETE /identity/v3/users/6c29f7b757ad47f2a72c407e9d380920 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:48.794649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:48.796291 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:48.812051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e7aa-b4af-482c-a375-b271dd1937b3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:48.868478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:48.869113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:48.869390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:48.869689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] PATH_INFO: `/v3/projects/6f42ec16ff89408c8f3981358d59769a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:48.870814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f42ec16ff89408c8f3981358d59769a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:48.873298 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:48.918614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f42ec16ff89408c8f3981358d59769a', 'request_id': 'req-f07279b0-b7b3-42f0-97cc-b3378c4dff33'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.924552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f42ec16ff89408c8f3981358d59769a', 'request_id': 'req-f07279b0-b7b3-42f0-97cc-b3378c4dff33'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.931717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f42ec16ff89408c8f3981358d59769a', 'request_id': 'req-f07279b0-b7b3-42f0-97cc-b3378c4dff33'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.942867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] The token cache is being invalidate because project 6f42ec16ff89408c8f3981358d59769a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:18:48.943159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.943822 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f07279b0-b7b3-42f0-97cc-b3378c4dff33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:18:48.945289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1128/2232] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:18:48 2022] DELETE /identity/v3/projects/6f42ec16ff89408c8f3981358d59769a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:48.950165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:48.950624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:48.950718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:48.970616 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:48.971790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:49.014170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:49.031304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1105/2233] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:49.040223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.040504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.040798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.060032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:49.061223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:49.068896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1129/2234] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:49.072990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.083285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9042d-08c3-4368-bb8f-7d8527dae4e3 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.087777 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.088364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.088639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.088904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.089538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:18:49.089833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.091983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.103355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1106/2235] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:18:49.107661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.116894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45219f4-ab86-4345-9006-005ef2363276 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.121504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.122087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.122362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.122632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.123265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.125196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.153622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1130/2236] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:49.157460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.167292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e132-78ae-4f49-be74-5692bec2a302 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.222177 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.222612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.222899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.223173 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.223830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.225756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.246769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1107/2237] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:49.251107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.256587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:49.263041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d5e3e-a528-41c5-9d30-12ab6e80f3d3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.268937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.269588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.269875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.270144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.270778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.272385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.282600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1131/2238] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:49.286689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.296429 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9826d6-71dc-45c1-a23d-70e1a1ffed15 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.300910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190522ca-8142-4c9f-a006-0ce99aa78ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.301487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190522ca-8142-4c9f-a006-0ce99aa78ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.301760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190522ca-8142-4c9f-a006-0ce99aa78ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.302031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190522ca-8142-4c9f-a006-0ce99aa78ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.302662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190522ca-8142-4c9f-a006-0ce99aa78ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.304266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190522ca-8142-4c9f-a006-0ce99aa78ce8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.314615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1108/2239] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:49.318675 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.329001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d031258-7c5f-427d-a570-8f0104efd2e1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.333561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.334204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.334481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.334750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] PATH_INFO: `/v3/projects/fade6f29801644988f0d4d7c81249c8d/users/62cf1f411f9c4abf9d63374724b686cf/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.349642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fade6f29801644988f0d4d7c81249c8d, user_id=62cf1f411f9c4abf9d63374724b686cf, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.352473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.365390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1132/2240] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:49 2022] PUT /identity/v3/projects/fade6f29801644988f0d4d7c81249c8d/users/62cf1f411f9c4abf9d63374724b686cf/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:49.376794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.377164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.377443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.405215 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] MFA Rules not processed for user `62cf1f411f9c4abf9d63374724b686cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:49.406402 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:49.468955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1109/2241] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:49.473590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.534245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e28c-3dbb-45f1-84fa-07d12d8b7da1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.538872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.539505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.539785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.540057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.540678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.542580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.568830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1133/2242] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:49.572857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.583942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7fe7-a490-4e5b-a120-11b817ad2971 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.624570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:49.641439 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.642041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.642323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.642599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.643226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.645190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.668191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1110/2243] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:18:49.669420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.679534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729026-013b-44e7-ae7e-5fffff91951e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.684630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.685223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.685501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.685774 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.686410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.688043 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.698409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1134/2244] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:49.703011 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.712924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20902aa6-9b2e-49bf-9e64-98810fb0171f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.717601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.718250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.718531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.718805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] PATH_INFO: `/v3/projects/0beffaf51f014e10ab9e2ab9cb8e71c3/users/e0a348e248594538a189ae90891699b0/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.734045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0beffaf51f014e10ab9e2ab9cb8e71c3, user_id=e0a348e248594538a189ae90891699b0, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.736766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.750141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1111/2245] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:49 2022] PUT /identity/v3/projects/0beffaf51f014e10ab9e2ab9cb8e71c3/users/e0a348e248594538a189ae90891699b0/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:18:49.754184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.764761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e90f47-8ef6-4b64-8ae4-5736f47279ba admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.820604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81eac-1b29-4812-aed6-1be07ab83ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.821200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81eac-1b29-4812-aed6-1be07ab83ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.821474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81eac-1b29-4812-aed6-1be07ab83ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.821742 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81eac-1b29-4812-aed6-1be07ab83ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.822373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81eac-1b29-4812-aed6-1be07ab83ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.824046 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81eac-1b29-4812-aed6-1be07ab83ae4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.833486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1135/2246] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:18:49.837655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.847820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f15fd-cd4a-416b-8332-6e119f1450a7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:49.852418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:49.853053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.853331 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.853718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] PATH_INFO: `/v3/projects/0beffaf51f014e10ab9e2ab9cb8e71c3/users/e0a348e248594538a189ae90891699b0/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.855537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0beffaf51f014e10ab9e2ab9cb8e71c3, user_id=e0a348e248594538a189ae90891699b0, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:49.858690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:49.868615 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1112/2247] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:18:49 2022] PUT /identity/v3/projects/0beffaf51f014e10ab9e2ab9cb8e71c3/users/e0a348e248594538a189ae90891699b0/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:18:49.879102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:49.879508 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:49.879786 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:49.907812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] MFA Rules not processed for user `e0a348e248594538a189ae90891699b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:18:49.909035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:49.935289 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:49.977048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1136/2248] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:18:49.988645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:49.990338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:18:50.047192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26983b6-26d7-43dd-854e-e3d1889dd1e8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:50.050825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:50.051424 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:50.051715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:50.051980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:50.061350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:50.062769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:50.071863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1113/2249] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:18:50.147426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:18:50.157344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3360561-f357-4413-bba1-587fe5e3bdce None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:18:50.161176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8c43d-609f-4bff-8b24-e3595d1a2663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:18:50.161772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8c43d-609f-4bff-8b24-e3595d1a2663 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:18:50.162047 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8c43d-609f-4bff-8b24-e3595d1a2663 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:18:50.162315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8c43d-609f-4bff-8b24-e3595d1a2663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:18:50.217847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8c43d-609f-4bff-8b24-e3595d1a2663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:18:50.219446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8c43d-609f-4bff-8b24-e3595d1a2663 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:18:50.228595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1137/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:18:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:00.067900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=50,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:00.224462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=45 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:04.966205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:05.026304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f9feb-0b9a-4993-99d1-7becd932fb63 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:05.030910 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:05.031585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:05.031869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:05.032143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] PATH_INFO: `/v3/users/62cf1f411f9c4abf9d63374724b686cf` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:05.033260 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cf1f411f9c4abf9d63374724b686cf)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:05.035188 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:05.081561 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cf1f411f9c4abf9d63374724b686cf'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.088356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cf1f411f9c4abf9d63374724b686cf'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.100410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cf1f411f9c4abf9d63374724b686cf'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.101068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cf1f411f9c4abf9d63374724b686cf'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.107262 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cf1f411f9c4abf9d63374724b686cf'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.113589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1114/2251] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:04 2022] DELETE /identity/v3/users/62cf1f411f9c4abf9d63374724b686cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:05.118151 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:05.118657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:05.118759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:05.137478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:05.138674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:05.195640 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1138/2252] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:05.205483 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:05.206838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:05.262732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2194f-7290-4d54-bfe5-1eef123a7d84 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:05.266344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:05.267200 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:05.267502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:05.267773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:05.276523 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:05.277943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:05.287728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1115/2253] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:05.550637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:05.551951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:05.569806 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f3e1-9a87-42bf-9375-0445f6bdc5c2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:05.575563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:05.576453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:05.576854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:05.577231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] PATH_INFO: `/v3/projects/fade6f29801644988f0d4d7c81249c8d` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:05.578479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fade6f29801644988f0d4d7c81249c8d)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:05.580514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:05.631504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fade6f29801644988f0d4d7c81249c8d', 'request_id': 'req-740ecdb7-788a-43c7-bae1-86315f93a9f7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.638424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fade6f29801644988f0d4d7c81249c8d', 'request_id': 'req-740ecdb7-788a-43c7-bae1-86315f93a9f7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.648317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fade6f29801644988f0d4d7c81249c8d', 'request_id': 'req-740ecdb7-788a-43c7-bae1-86315f93a9f7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.659485 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] The token cache is being invalidate because project fade6f29801644988f0d4d7c81249c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:05.659779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.660401 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.661891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1139/2254] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:05 2022] DELETE /identity/v3/projects/fade6f29801644988f0d4d7c81249c8d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:05.666618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:05.676646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085e21-ce4f-429d-a332-d22f20e01594 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:05.695308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:05.735752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:05.736407 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:05.736682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:05.736949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] PATH_INFO: `/v3/users/e0a348e248594538a189ae90891699b0` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:05.738057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a348e248594538a189ae90891699b0)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:05.739995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:05.785066 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a348e248594538a189ae90891699b0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.791781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a348e248594538a189ae90891699b0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.803768 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a348e248594538a189ae90891699b0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.804421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a348e248594538a189ae90891699b0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.811677 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-70a3b12e-2d71-4923-9080-cd92d7b04405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a348e248594538a189ae90891699b0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:05.817949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1116/2255] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:05 2022] DELETE /identity/v3/users/e0a348e248594538a189ae90891699b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:06.082297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.083740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:06.098980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ecdb7-788a-43c7-bae1-86315f93a9f7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.154564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.155185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.155980 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.156261 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] PATH_INFO: `/v3/projects/0beffaf51f014e10ab9e2ab9cb8e71c3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.157481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0beffaf51f014e10ab9e2ab9cb8e71c3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.159374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.188858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:06.208160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0beffaf51f014e10ab9e2ab9cb8e71c3', 'request_id': 'req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:06.214123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0beffaf51f014e10ab9e2ab9cb8e71c3', 'request_id': 'req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:06.221813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0beffaf51f014e10ab9e2ab9cb8e71c3', 'request_id': 'req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:06.232187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] The token cache is being invalidate because project 0beffaf51f014e10ab9e2ab9cb8e71c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:06.232481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:06.233119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-13fc4ab0-2e45-4e21-837e-c2c45c4d6c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:06.234705 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1140/2256] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:06 2022] DELETE /identity/v3/projects/0beffaf51f014e10ab9e2ab9cb8e71c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:06.239662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.240132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.240253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.259656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:06.260795 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:06.318455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1117/2257] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:06.326274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.326559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.326834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.347060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:06.348292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:06.356131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1141/2258] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:06.360238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.369720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176d5e-fd63-4214-bf13-7860086d2153 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.374329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.374923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.375207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.375521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.376169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:06.376476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.378070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.389308 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1118/2259] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:06.394148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.403299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54405b-cb08-4de8-b7a4-7b9021786103 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.408520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.409109 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.409385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.409656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.410290 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.412214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.440019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1142/2260] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:06.444068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.454431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92c831-0d01-4cb0-b349-73fe9f844b86 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.479966 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:06.511727 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.512252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.512533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.512807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.513440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.515904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.537216 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1119/2261] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:19:06.541449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.551739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b209-b4cb-4c57-bb72-68676a9b0a2d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.556348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.556942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.557228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.557501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.558137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.559761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.569419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1143/2262] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:06.573252 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.583559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd764e9d-724c-4242-bf37-53ec0c05d88d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.588081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cc06e-1629-4112-8e1e-ae81ee260f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.588671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc06e-1629-4112-8e1e-ae81ee260f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.588946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc06e-1629-4112-8e1e-ae81ee260f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.589217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc06e-1629-4112-8e1e-ae81ee260f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.589973 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cc06e-1629-4112-8e1e-ae81ee260f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.591591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cc06e-1629-4112-8e1e-ae81ee260f60 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.602426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1120/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:06.606305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.616215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547f24-1d3e-4e68-81fc-80c65cc0ade3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.620830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.621469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.621748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.622018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] PATH_INFO: `/v3/projects/9824dcb8672f4354b640cad256f01014/users/24047821f8e54bc2965fa004839ce874/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.636610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9824dcb8672f4354b640cad256f01014, user_id=24047821f8e54bc2965fa004839ce874, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.639247 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.652507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1144/2264] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:06 2022] PUT /identity/v3/projects/9824dcb8672f4354b640cad256f01014/users/24047821f8e54bc2965fa004839ce874/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:06.662740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.663025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.663303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.690610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] MFA Rules not processed for user `24047821f8e54bc2965fa004839ce874`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:06.691840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:06.753614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1121/2265] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:06.758105 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.818991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505f80c-f271-4ce5-8115-9aaea36614ec admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.823643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.824242 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.824522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.824798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.825432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.827347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.855762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1145/2266] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:06.859766 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.870180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5006b-6fd0-4e4b-9e68-55949d376bdb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.925642 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.926241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.926526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.926803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.927459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.929389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.951442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1122/2267] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:06 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:19:06.955453 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.965625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf023-68d5-441a-a6fd-ec9743311043 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:06.970207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:06.970799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:06.971078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:06.971351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:06.972015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:06.973595 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:06.983733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1146/2268] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:06.987994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:06.997901 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab8366-3a50-4f13-8967-eec3870382ac admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.003133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2a565-bc49-4e25-a2aa-bb2d6a5b1c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.003760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2a565-bc49-4e25-a2aa-bb2d6a5b1c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.004035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2a565-bc49-4e25-a2aa-bb2d6a5b1c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.004306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2a565-bc49-4e25-a2aa-bb2d6a5b1c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.004943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2a565-bc49-4e25-a2aa-bb2d6a5b1c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.006544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2a565-bc49-4e25-a2aa-bb2d6a5b1c02 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.016265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1123/2269] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:07.020416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.030175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c238f-116e-4ac5-a795-760f1b32e955 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.034750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.035382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.035690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.035964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] PATH_INFO: `/v3/projects/0a5c9e288b3044d0b77629e0760b09dc/users/2aa2f6b4bbe34f8d98ecc18b8a942dec/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.050841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5c9e288b3044d0b77629e0760b09dc, user_id=2aa2f6b4bbe34f8d98ecc18b8a942dec, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.053532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.061934 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:07.067730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1147/2270] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:07 2022] PUT /identity/v3/projects/0a5c9e288b3044d0b77629e0760b09dc/users/2aa2f6b4bbe34f8d98ecc18b8a942dec/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:07.078996 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.079347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.079662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.106459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] MFA Rules not processed for user `2aa2f6b4bbe34f8d98ecc18b8a942dec`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:07.107685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:07.112275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:07.173691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1124/2271] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:07.178173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.243876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1123c-4355-4db9-b845-afbd13be6741 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.248601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.249202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.249482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.249758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.251044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.252985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.278542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1148/2272] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:07 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:07.282631 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.293291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893247dd-7ea5-4733-9491-c6dd1776316a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.347803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.348323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.348603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.348871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.349499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.351427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.372125 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1125/2273] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:07 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:07.376248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.386338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88549132-8070-4d19-89b1-06200cabdfb1 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.390901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.391529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.392072 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.392346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.392987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.394579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.404803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1149/2274] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:07.409217 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.418952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444ddd-614c-41df-942d-9d47cdb6b71c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.424205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.424865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.425149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.425421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] PATH_INFO: `/v3/projects/4552f7c104c24675ae6d18c650239d6b/users/a925bad94e154f3bb1cd431c58daab0d/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.439762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4552f7c104c24675ae6d18c650239d6b, user_id=a925bad94e154f3bb1cd431c58daab0d, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.442401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.454320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1126/2275] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:07 2022] PUT /identity/v3/projects/4552f7c104c24675ae6d18c650239d6b/users/a925bad94e154f3bb1cd431c58daab0d/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:07.458246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.468091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c607a-96a6-4110-9930-ddde71caef5a admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.522954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aba91-46a7-4f00-8c72-17c1b432b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.523568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aba91-46a7-4f00-8c72-17c1b432b0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.523846 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aba91-46a7-4f00-8c72-17c1b432b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.524115 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aba91-46a7-4f00-8c72-17c1b432b0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.524744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aba91-46a7-4f00-8c72-17c1b432b0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.526327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aba91-46a7-4f00-8c72-17c1b432b0e6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.536271 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1150/2276] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:07.540346 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.553007 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2fc5-3028-4a35-8b50-7d19396444d8 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.557929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.558587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.558867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.559140 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] PATH_INFO: `/v3/projects/4552f7c104c24675ae6d18c650239d6b/users/a925bad94e154f3bb1cd431c58daab0d/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.561477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4552f7c104c24675ae6d18c650239d6b, user_id=a925bad94e154f3bb1cd431c58daab0d, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.564132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.575472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1127/2277] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:07 2022] PUT /identity/v3/projects/4552f7c104c24675ae6d18c650239d6b/users/a925bad94e154f3bb1cd431c58daab0d/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:19:07.585690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.586013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.586274 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.615319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] MFA Rules not processed for user `a925bad94e154f3bb1cd431c58daab0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:07.616646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:07.675442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:07.685493 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1151/2278] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:07.696681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:07.698422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:07.755505 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1f156-6212-4ef5-90fd-79d7cb195df3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:07.759123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:07.759759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:07.760041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:07.760319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:07.770137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:07.821051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:07.823147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:07.838130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1128/2279] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:09.345349 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:09.346744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:09.358489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3834-77c6-4eb0-b7e2-bd615b0f9ed1 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:09.361990 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:09.362585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:09.362864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:09.363138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:09.418338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:09.419757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:09.428745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1152/2280] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:09.948417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:09.957243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4496-b3b5-4913-99bb-aac1a06fbcc8 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:09.960941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dc44b-64be-468f-a768-933f695c5859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:09.961779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dc44b-64be-468f-a768-933f695c5859 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:09.962057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dc44b-64be-468f-a768-933f695c5859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:09.962330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dc44b-64be-468f-a768-933f695c5859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:09.971205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dc44b-64be-468f-a768-933f695c5859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:09.972672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dc44b-64be-468f-a768-933f695c5859 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:09.982647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1129/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:13.858793 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:13.920418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f865b-e576-41d5-b9e6-dd27d01d330b service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:13.925433 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:13.926055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:13.926334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:13.926606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] PATH_INFO: `/v3/users/24047821f8e54bc2965fa004839ce874` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:13.927741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24047821f8e54bc2965fa004839ce874)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:13.929662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:13.975175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24047821f8e54bc2965fa004839ce874'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:13.975848 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24047821f8e54bc2965fa004839ce874'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:13.988245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24047821f8e54bc2965fa004839ce874'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:13.995379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24047821f8e54bc2965fa004839ce874'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:13.996015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24047821f8e54bc2965fa004839ce874'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.008078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1153/2282] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:13 2022] DELETE /identity/v3/users/24047821f8e54bc2965fa004839ce874 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:14.012556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:14.013010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:14.013118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:14.033191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:14.034385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:14.091529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1130/2283] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:19:14.101250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:14.102666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:14.116871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:14.161090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9778fa-f266-4335-9236-a73158315577 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:14.164767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:14.165361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:14.165646 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:14.165915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:14.174707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:14.176162 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:14.185510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1154/2284] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:14.450551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:14.452052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:14.463969 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c374-6812-495b-8e64-05d03d185efb None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:14.468562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:14.469220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:14.469471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:14.469743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] PATH_INFO: `/v3/projects/9824dcb8672f4354b640cad256f01014` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:14.470872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9824dcb8672f4354b640cad256f01014)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:14.472813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:14.519271 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9824dcb8672f4354b640cad256f01014', 'request_id': 'req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.525195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9824dcb8672f4354b640cad256f01014', 'request_id': 'req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.532467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9824dcb8672f4354b640cad256f01014', 'request_id': 'req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.542695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] The token cache is being invalidate because project 9824dcb8672f4354b640cad256f01014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:14.542989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.543643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.545186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1131/2285] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:14 2022] DELETE /identity/v3/projects/9824dcb8672f4354b640cad256f01014 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:19:14.549840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:14.559813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a31535-4c19-40b7-ac7d-756f79896852 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:14.614923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:14.615579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:14.615860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:14.616134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] PATH_INFO: `/v3/users/2aa2f6b4bbe34f8d98ecc18b8a942dec` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:14.617249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa2f6b4bbe34f8d98ecc18b8a942dec)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:14.619166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:14.664828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa2f6b4bbe34f8d98ecc18b8a942dec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.665481 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa2f6b4bbe34f8d98ecc18b8a942dec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.677627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa2f6b4bbe34f8d98ecc18b8a942dec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.684564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa2f6b4bbe34f8d98ecc18b8a942dec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.685207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa2f6b4bbe34f8d98ecc18b8a942dec'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:14.697619 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1155/2286] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:14 2022] DELETE /identity/v3/users/2aa2f6b4bbe34f8d98ecc18b8a942dec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:19:14.962657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:14.964128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:14.979254 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66b1b3-d67b-46ab-b467-f11628cd3f3d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:14.998737 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:15.038746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:15.039391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.039671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.039941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] PATH_INFO: `/v3/projects/0a5c9e288b3044d0b77629e0760b09dc` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.041042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5c9e288b3044d0b77629e0760b09dc)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:15.042983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:15.088706 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5c9e288b3044d0b77629e0760b09dc', 'request_id': 'req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.095138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5c9e288b3044d0b77629e0760b09dc', 'request_id': 'req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.102676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5c9e288b3044d0b77629e0760b09dc', 'request_id': 'req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.113943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] The token cache is being invalidate because project 0a5c9e288b3044d0b77629e0760b09dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:15.114226 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.114905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.116651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1132/2287] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:14 2022] DELETE /identity/v3/projects/0a5c9e288b3044d0b77629e0760b09dc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:15.120702 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:15.122071 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:15.134663 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92a49-bd64-4227-bc72-2361ec1955ba admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:15.167319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:15.192698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:15.193321 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.193599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.193870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] PATH_INFO: `/v3/users/a925bad94e154f3bb1cd431c58daab0d` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.194973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a925bad94e154f3bb1cd431c58daab0d)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:15.196925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:15.241220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a925bad94e154f3bb1cd431c58daab0d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.241873 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a925bad94e154f3bb1cd431c58daab0d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.254123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a925bad94e154f3bb1cd431c58daab0d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.260749 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a925bad94e154f3bb1cd431c58daab0d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.261371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1f27a244-d242-44ca-8569-8fe55973c7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a925bad94e154f3bb1cd431c58daab0d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.274138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1156/2288] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:15 2022] DELETE /identity/v3/users/a925bad94e154f3bb1cd431c58daab0d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:15.537551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:15.539094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:15.552490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964fb2-fe30-4c2e-ad9d-ea0c48a98718 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:15.611492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:15.612128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.612405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.612688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] PATH_INFO: `/v3/projects/4552f7c104c24675ae6d18c650239d6b` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.613812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4552f7c104c24675ae6d18c650239d6b)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:15.615763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:15.664584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4552f7c104c24675ae6d18c650239d6b', 'request_id': 'req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.670455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4552f7c104c24675ae6d18c650239d6b', 'request_id': 'req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.672092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:15.679434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4552f7c104c24675ae6d18c650239d6b', 'request_id': 'req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.691249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] The token cache is being invalidate because project 4552f7c104c24675ae6d18c650239d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:15.691558 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.692197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-5ea7e11b-6d7e-4ad0-b68f-022ac6459eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:15.693856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1133/2289] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:15 2022] DELETE /identity/v3/projects/4552f7c104c24675ae6d18c650239d6b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:15.699567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.699856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.700155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.720522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:15.721722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:15.780579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1157/2290] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:15.789569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504c701-696b-4897-98b8-26434df56321 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.789858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504c701-696b-4897-98b8-26434df56321 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.790129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504c701-696b-4897-98b8-26434df56321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.809398 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f504c701-696b-4897-98b8-26434df56321 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:15.810584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f504c701-696b-4897-98b8-26434df56321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:15.818943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1134/2291] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:15.823432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:15.833929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c021-82b4-440b-a125-ec1195484c11 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:15.838462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:15.839055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.839334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.839642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.840286 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:15.840587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:15.842202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:15.853461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1158/2292] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:15.857566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504c701-696b-4897-98b8-26434df56321 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:15.866791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504c701-696b-4897-98b8-26434df56321 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:15.871575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:15.872195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.872468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.872736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.873614 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:15.875559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:15.911336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1135/2293] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:15 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:15.912750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:15.922507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3ad99-c2fc-4577-bf38-15e3173059d0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:15.967733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:15.986996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:15.987635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:15.987917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:15.988190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:15.988835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:15.991390 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:16.016116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1159/2294] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:15 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:16.017195 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:16.027718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001cd6f-6eca-46d7-a384-4e69338e8795 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:16.032436 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:16.033034 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:16.033314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:16.033584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:16.034259 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:16.035885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:16.049294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1136/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:16.050373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:16.061212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea74b-5132-41ae-a7f7-7f42314b997d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:16.066249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5822a-e349-494e-805e-02c3edd84b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:16.066979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5822a-e349-494e-805e-02c3edd84b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:16.067553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5822a-e349-494e-805e-02c3edd84b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:16.067783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5822a-e349-494e-805e-02c3edd84b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:16.068556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5822a-e349-494e-805e-02c3edd84b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:16.070030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5822a-e349-494e-805e-02c3edd84b8b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:16.083977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1160/2296] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:16.085243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:16.095363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886bc17-3fc2-4453-a0cf-ebfbad47a94f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:16.100109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:16.100755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:16.101036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:16.101316 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] PATH_INFO: `/v3/projects/67a5c74c86a84494b0abff26f0fd8dba/users/e296aabbd3f84058b803e1d42dce0a97/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:16.117860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a5c74c86a84494b0abff26f0fd8dba, user_id=e296aabbd3f84058b803e1d42dce0a97, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:16.120618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:16.135141 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1137/2297] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:16 2022] PUT /identity/v3/projects/67a5c74c86a84494b0abff26f0fd8dba/users/e296aabbd3f84058b803e1d42dce0a97/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:16.146282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:16.146769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:16.146890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:16.180843 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] MFA Rules not processed for user `e296aabbd3f84058b803e1d42dce0a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:16.182086 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:16.250081 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1161/2298] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:19:16.262620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:16.264362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:16.323037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b8c0-3e05-4c72-b8b8-1d7f211a3c7c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:16.327099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:16.327819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:16.328166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:16.328513 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:16.338043 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:16.339455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:16.348691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1138/2299] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:22.806660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:22.808113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:22.865300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005a295-c92a-4c6f-8b2b-a727594ac010 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:22.868851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:22.869451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:22.869728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:22.869999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:22.871744 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:22.936174 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:22.937617 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:22.943069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:22.948265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1162/2300] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:25.891934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:25.894786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:25.911250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f34ba-de83-4f72-b78f-4f5c94e77c40 service glance] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:25.916883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:25.917538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:25.917804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:25.918069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] PATH_INFO: `/v3/users/cdcf94479e2f4ca7bdf455dbab82e336` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:25.919389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcf94479e2f4ca7bdf455dbab82e336)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:25.921531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:25.971995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcf94479e2f4ca7bdf455dbab82e336'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:25.978870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcf94479e2f4ca7bdf455dbab82e336'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:25.991467 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcf94479e2f4ca7bdf455dbab82e336'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:25.992241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcf94479e2f4ca7bdf455dbab82e336'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:25.994874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:INSERT=4,keystone:DELETE=12,keystone:SELECT=84 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:26.000758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-9b4a0fd6-1062-425c-94b0-e326fbe81027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcf94479e2f4ca7bdf455dbab82e336'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:26.007770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1139/2301] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:25 2022] DELETE /identity/v3/users/cdcf94479e2f4ca7bdf455dbab82e336 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:26.183807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.195328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7561-df36-46da-9cdc-5007a8bcd784 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.251761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.252925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.253202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.253475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] PATH_INFO: `/v3/projects/2c6347121ec446cf8796a49289465f12` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.254588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6347121ec446cf8796a49289465f12)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.256560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.303812 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6347121ec446cf8796a49289465f12', 'request_id': 'req-d05c9702-9c62-496f-8312-99e341994ade'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:26.309907 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6347121ec446cf8796a49289465f12', 'request_id': 'req-d05c9702-9c62-496f-8312-99e341994ade'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:26.317884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6347121ec446cf8796a49289465f12', 'request_id': 'req-d05c9702-9c62-496f-8312-99e341994ade'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:26.328527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] The token cache is being invalidate because project 2c6347121ec446cf8796a49289465f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:26.328816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:26.329436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d05c9702-9c62-496f-8312-99e341994ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:26.331772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1163/2302] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:26 2022] DELETE /identity/v3/projects/2c6347121ec446cf8796a49289465f12 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:26.336796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.337111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.337387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.357376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:26.358607 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:26.416637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1140/2303] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:26.425282 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.425562 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.425860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.446027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:26.447140 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:26.454847 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1164/2304] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:26.458905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.468564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c5d1c-3ae0-4d3f-8412-07da5e560254 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.473338 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.473936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.474221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.474497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.475176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:26.475515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.477165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.489314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1141/2305] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:26.493522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.504171 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6e44b-b5fe-4fe0-b183-eeaa81bdc256 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.509107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.509710 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.510007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.510281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.510915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.512854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.538970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1165/2306] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:26.543057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.554050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2ac20-4f38-4597-a7df-9d582dcd1907 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.609009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.609605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.609886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.610160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.610791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.613341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.634775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1142/2307] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:19:26.638920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.649386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c7f9b-19d9-4ff5-badf-6f2269208a2b admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.653939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.654528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.654805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.655076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.655745 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.657337 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.666899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1166/2308] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:26.670691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.681240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07570-7a2b-48ad-b429-2fcd713dbddc admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.691612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b1d0d-a236-41c6-9e71-68a806e0d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.692225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b1d0d-a236-41c6-9e71-68a806e0d3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.692522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b1d0d-a236-41c6-9e71-68a806e0d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.692775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b1d0d-a236-41c6-9e71-68a806e0d3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.693428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b1d0d-a236-41c6-9e71-68a806e0d3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.695042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b1d0d-a236-41c6-9e71-68a806e0d3b7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.706037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1143/2309] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:26.710304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.720341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8844-e973-4f35-a939-ecf8d906160d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.725013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.725664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.725942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.726212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] PATH_INFO: `/v3/projects/0509a96bd89a4ff5a6c2088e6b872c6f/users/e9b31d3ee80a4af5b6ba43cf62d6b447/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.741374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0509a96bd89a4ff5a6c2088e6b872c6f, user_id=e9b31d3ee80a4af5b6ba43cf62d6b447, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.744181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.757432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1167/2310] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:26 2022] PUT /identity/v3/projects/0509a96bd89a4ff5a6c2088e6b872c6f/users/e9b31d3ee80a4af5b6ba43cf62d6b447/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:26.767787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.768889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.769175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.796815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] MFA Rules not processed for user `e9b31d3ee80a4af5b6ba43cf62d6b447`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:26.798003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:26.843740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:26.864152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1144/2311] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:26.868596 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.900446 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:26.937035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dbfd9-5bbc-4b80-9929-f95b675be347 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:26.941719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:26.942322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:26.942597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:26.942868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:26.943530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:26.945422 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:26.978527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1168/2312] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:26.979794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:26.991167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e95fa-e560-4b51-8edb-7b25d54df661 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.052080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.052688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.053060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.053227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.053851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.055790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.077027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1145/2313] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:26 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:27.081041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:27.091317 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c0257-3693-4ca2-a57c-0fbd976417cd admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.096468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.097064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.097351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.097622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.098258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.099894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.109716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1169/2314] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:27.114123 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:27.123958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fc9c0-2188-49ab-b0bc-3523c70c5cf0 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.128509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.129144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.129423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.129695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] PATH_INFO: `/v3/projects/bc1b28c00c1b4848abd48521bad0d22a/users/7015617b704e428f94866116d2b5ca80/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.144192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1b28c00c1b4848abd48521bad0d22a, user_id=7015617b704e428f94866116d2b5ca80, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.146840 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.159817 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1146/2315] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:27 2022] PUT /identity/v3/projects/bc1b28c00c1b4848abd48521bad0d22a/users/7015617b704e428f94866116d2b5ca80/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:27.163681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:27.173676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fd0b9-e90b-4d28-984d-a27f86ef97f6 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.231239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ccd9-cf53-43d9-976f-4a0582b445c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.231919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ccd9-cf53-43d9-976f-4a0582b445c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.232061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ccd9-cf53-43d9-976f-4a0582b445c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.232330 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ccd9-cf53-43d9-976f-4a0582b445c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.232959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ccd9-cf53-43d9-976f-4a0582b445c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.234590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ccd9-cf53-43d9-976f-4a0582b445c2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.244292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1170/2316] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:27.248353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:27.258473 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37b9f-119d-4bc2-8c9a-58e2a6fdf838 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.263024 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.263687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.263983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.264235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] PATH_INFO: `/v3/projects/bc1b28c00c1b4848abd48521bad0d22a/users/7015617b704e428f94866116d2b5ca80/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.266134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1b28c00c1b4848abd48521bad0d22a, user_id=7015617b704e428f94866116d2b5ca80, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.269601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.279459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1147/2317] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:27 2022] PUT /identity/v3/projects/bc1b28c00c1b4848abd48521bad0d22a/users/7015617b704e428f94866116d2b5ca80/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:27.291530 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.291814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.292087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.319270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] MFA Rules not processed for user `7015617b704e428f94866116d2b5ca80`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:27.320537 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:27.387712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1171/2318] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:27.399434 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:27.401182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:27.457184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ca14c-7a7a-487f-b788-c86c99f2f6e7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.460834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.461427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.461708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.461977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.471454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.472885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.482342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1148/2319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:27.556962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:27.567167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef516797-1187-4efc-b715-c705d49c7628 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:27.570842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24915eef-0599-417e-831b-dfbcdcb79b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:27.571477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24915eef-0599-417e-831b-dfbcdcb79b83 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:27.571758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24915eef-0599-417e-831b-dfbcdcb79b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:27.572030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24915eef-0599-417e-831b-dfbcdcb79b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:27.591758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:27.629571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24915eef-0599-417e-831b-dfbcdcb79b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:27.631006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24915eef-0599-417e-831b-dfbcdcb79b83 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:27.639759 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1172/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:34.606280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:34.650804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:34.668842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6f1e3-2a27-49ef-b4fc-107372365e78 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:34.673307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:34.673921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:34.674196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:34.674463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] PATH_INFO: `/v3/users/e9b31d3ee80a4af5b6ba43cf62d6b447` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:34.675593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b31d3ee80a4af5b6ba43cf62d6b447)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:34.677507 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:34.723484 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b31d3ee80a4af5b6ba43cf62d6b447'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:34.730447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b31d3ee80a4af5b6ba43cf62d6b447'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:34.742203 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b31d3ee80a4af5b6ba43cf62d6b447'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:34.742899 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b31d3ee80a4af5b6ba43cf62d6b447'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:34.750009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b31d3ee80a4af5b6ba43cf62d6b447'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:34.755911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1149/2321] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:34 2022] DELETE /identity/v3/users/e9b31d3ee80a4af5b6ba43cf62d6b447 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:34.760436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:34.760903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:34.761002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:34.780682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:34.781888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:34.838761 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1173/2322] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:34.848979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:34.850374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:34.906659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e1ee-999b-4829-9cb9-50e2e8942bc2 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:34.910904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:34.911528 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:34.911813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:34.912085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:34.921134 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:34.922568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:34.934637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1150/2323] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:35.201716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:35.203186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:35.215778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b428b11-4001-49cc-8c20-9531a80fb0ed None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:35.220403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:35.221060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:35.221331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:35.221622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] PATH_INFO: `/v3/projects/0509a96bd89a4ff5a6c2088e6b872c6f` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:35.222768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0509a96bd89a4ff5a6c2088e6b872c6f)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:35.224704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:35.271061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0509a96bd89a4ff5a6c2088e6b872c6f', 'request_id': 'req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.276994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0509a96bd89a4ff5a6c2088e6b872c6f', 'request_id': 'req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.284323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0509a96bd89a4ff5a6c2088e6b872c6f', 'request_id': 'req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.294779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] The token cache is being invalidate because project 0509a96bd89a4ff5a6c2088e6b872c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:35.295066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.295701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.297168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1174/2324] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:35 2022] DELETE /identity/v3/projects/0509a96bd89a4ff5a6c2088e6b872c6f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:35.301166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:35.310515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b92090-47bb-415e-bcb4-41e3db25da3d service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:35.365265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:35.365874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:35.366151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:35.366420 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] PATH_INFO: `/v3/users/7015617b704e428f94866116d2b5ca80` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:35.367548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7015617b704e428f94866116d2b5ca80)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:35.369465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:35.374572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:35.417076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7015617b704e428f94866116d2b5ca80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.423697 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7015617b704e428f94866116d2b5ca80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.435775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7015617b704e428f94866116d2b5ca80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.436432 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7015617b704e428f94866116d2b5ca80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.444049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-e3d39b5d-87bf-4c8b-9dcf-eaed47b7250c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7015617b704e428f94866116d2b5ca80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.449835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1151/2325] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:35 2022] DELETE /identity/v3/users/7015617b704e428f94866116d2b5ca80 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:35.717717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:35.719246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:35.734379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd2a3-3e10-47db-a1da-6e9b78df3e57 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:35.780611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:35.798260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:35.798914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:35.799190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:35.799490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] PATH_INFO: `/v3/projects/bc1b28c00c1b4848abd48521bad0d22a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:35.800607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1b28c00c1b4848abd48521bad0d22a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:35.803060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:35.848255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1b28c00c1b4848abd48521bad0d22a', 'request_id': 'req-cee99cd5-0781-4631-a189-08da89ce4e1d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.854474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1b28c00c1b4848abd48521bad0d22a', 'request_id': 'req-cee99cd5-0781-4631-a189-08da89ce4e1d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.864456 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1b28c00c1b4848abd48521bad0d22a', 'request_id': 'req-cee99cd5-0781-4631-a189-08da89ce4e1d'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.874547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] The token cache is being invalidate because project bc1b28c00c1b4848abd48521bad0d22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:35.874833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.875473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-cee99cd5-0781-4631-a189-08da89ce4e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:35.876942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1175/2326] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:35 2022] DELETE /identity/v3/projects/bc1b28c00c1b4848abd48521bad0d22a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:35.881851 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:35.882349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:35.882465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:35.903557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:35.904791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:35.963077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1152/2327] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:35.970716 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:35.971011 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:35.971287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:35.991950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:35.993156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:36.001328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1176/2328] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:36.005506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.015169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b68449-a596-4125-b516-f4609fe59b44 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.020139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.020736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.021019 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.021291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.021933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:36.022238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.023867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.035623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1153/2329] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:19:36.039659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.049400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d74f2-10a8-4a7a-a870-921b4b27a350 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.054505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.055137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.055425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.055712 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.056345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.058225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.089121 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1177/2330] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:36 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:36.090796 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.104032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057461-d524-4ef1-bc10-6985c0b3e9f2 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.159196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.159818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.160106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.160938 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.161559 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.163493 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.183581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1154/2331] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:36 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:36.187777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.198027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84e21-cd30-40bf-b6aa-b53734fad036 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.202531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.203113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.203387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.203684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.204316 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.205894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.216728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1178/2332] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:36.220526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.225512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:36.232306 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbd60a-e86d-460d-be90-2ca381478d19 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.238065 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac880f-15a4-4c78-814f-461d73b54371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.239164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac880f-15a4-4c78-814f-461d73b54371 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.239477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac880f-15a4-4c78-814f-461d73b54371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.239759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac880f-15a4-4c78-814f-461d73b54371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.240403 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac880f-15a4-4c78-814f-461d73b54371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.242003 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac880f-15a4-4c78-814f-461d73b54371 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.253789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1155/2333] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:36.258491 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.268436 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffbb31-9076-4e64-9fdc-f59375697f06 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.273322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.273993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.274273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.274549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] PATH_INFO: `/v3/projects/259ca9aa7dd141f1b8dcf35e6771ce27/users/9be62dc17bb34eeb8e682d1d7aef649a/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.288879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=259ca9aa7dd141f1b8dcf35e6771ce27, user_id=9be62dc17bb34eeb8e682d1d7aef649a, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.291563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.304664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1179/2334] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:36 2022] PUT /identity/v3/projects/259ca9aa7dd141f1b8dcf35e6771ce27/users/9be62dc17bb34eeb8e682d1d7aef649a/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:36.316070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.316990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.317233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.344025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] MFA Rules not processed for user `9be62dc17bb34eeb8e682d1d7aef649a`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:36.345238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:36.407998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1156/2335] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:36.412480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.473420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045de2d-dc48-4e88-92d8-00719198b5cd admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.477964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.478559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.478926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.479203 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.479871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.481776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.496969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:36.510703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1180/2336] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:36 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:36.514736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.525489 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7308-6bd3-45e0-8a07-e60775bcd1c7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.581022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.581628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.581913 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.582742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.583362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.585358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.605284 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1157/2337] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:36 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:36.609780 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.620560 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2201-7f4b-4916-ba01-d56fa26d937e admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.625168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.625834 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.626113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.626387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.627035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.628665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.639893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1181/2338] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:36.644446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.655884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ebe5-6075-447d-bf37-93306759bb2d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.660605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.661244 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.661546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.661819 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] PATH_INFO: `/v3/projects/fc1bc832f352449d97ca9f1fc3732dd1/users/16ee6f072ac04419a5a842a80201855a/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.676990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1bc832f352449d97ca9f1fc3732dd1, user_id=16ee6f072ac04419a5a842a80201855a, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.680212 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.694459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1158/2339] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:36 2022] PUT /identity/v3/projects/fc1bc832f352449d97ca9f1fc3732dd1/users/16ee6f072ac04419a5a842a80201855a/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:36.698426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.709128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d01f1-6bd2-4a6e-9ea1-e8e73abb0e63 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.764666 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac9c93-ee68-46b6-89ab-c00ddf5bf2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.765270 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac9c93-ee68-46b6-89ab-c00ddf5bf2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.765572 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac9c93-ee68-46b6-89ab-c00ddf5bf2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.765845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac9c93-ee68-46b6-89ab-c00ddf5bf2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.766482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac9c93-ee68-46b6-89ab-c00ddf5bf2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.768108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac9c93-ee68-46b6-89ab-c00ddf5bf2b3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.778375 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1182/2340] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:36.782531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.793521 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384cb3d-62d1-4ba9-9aeb-a329cd6b47e5 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:36.798192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:36.798870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.799153 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.799455 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] PATH_INFO: `/v3/projects/fc1bc832f352449d97ca9f1fc3732dd1/users/16ee6f072ac04419a5a842a80201855a/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.801389 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1bc832f352449d97ca9f1fc3732dd1, user_id=16ee6f072ac04419a5a842a80201855a, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:36.804117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:36.814731 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1159/2341] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:36 2022] PUT /identity/v3/projects/fc1bc832f352449d97ca9f1fc3732dd1/users/16ee6f072ac04419a5a842a80201855a/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:36.825250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:36.825779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:36.825779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:36.853991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] MFA Rules not processed for user `16ee6f072ac04419a5a842a80201855a`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:36.855202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:36.921258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1183/2342] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:36.934957 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:36.936776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:36.973009 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:36.996769 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e4074-2ec1-4a1f-8d05-9bd9b913dacd admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:37.000592 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f378207-63a5-428b-897b-7b883e05763d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:37.001190 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378207-63a5-428b-897b-7b883e05763d service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:37.001466 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378207-63a5-428b-897b-7b883e05763d service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:37.001734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378207-63a5-428b-897b-7b883e05763d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:37.011532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378207-63a5-428b-897b-7b883e05763d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:37.012947 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378207-63a5-428b-897b-7b883e05763d service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:37.022478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1160/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:38.391760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:38.454038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def3876-0512-4ba8-b959-86f4d14ddd6b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:38.458703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:38.459320 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:38.459626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:38.459904 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] PATH_INFO: `/v3/users/9be62dc17bb34eeb8e682d1d7aef649a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:38.461008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be62dc17bb34eeb8e682d1d7aef649a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:38.462923 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:38.468141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:38.508489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be62dc17bb34eeb8e682d1d7aef649a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:38.509153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be62dc17bb34eeb8e682d1d7aef649a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:38.521798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be62dc17bb34eeb8e682d1d7aef649a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:38.529459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be62dc17bb34eeb8e682d1d7aef649a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:38.530079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be62dc17bb34eeb8e682d1d7aef649a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:38.542119 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1184/2344] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:38 2022] DELETE /identity/v3/users/9be62dc17bb34eeb8e682d1d7aef649a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:38.547446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:38.549352 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:38.550767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:38.574980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:38.576242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:38.636570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1161/2345] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:38.647503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:38.648918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:38.709615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07dc4f-71ee-4e07-afc2-dcb2beb6fe2c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:38.713590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:38.714201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:38.714479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:38.714751 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:38.725000 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:38.726454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:38.737565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1185/2346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:39.033755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:39.035163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:39.047725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca7db-cae8-402a-a815-d70a65aa5713 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:39.054083 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:39.054721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.055056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.055384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] PATH_INFO: `/v3/projects/259ca9aa7dd141f1b8dcf35e6771ce27` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.056539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=259ca9aa7dd141f1b8dcf35e6771ce27)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:39.058468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:39.105641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259ca9aa7dd141f1b8dcf35e6771ce27', 'request_id': 'req-84511f9f-58b6-42d3-9262-5e2ff8465c3c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.111791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259ca9aa7dd141f1b8dcf35e6771ce27', 'request_id': 'req-84511f9f-58b6-42d3-9262-5e2ff8465c3c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.119487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259ca9aa7dd141f1b8dcf35e6771ce27', 'request_id': 'req-84511f9f-58b6-42d3-9262-5e2ff8465c3c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.129661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] The token cache is being invalidate because project 259ca9aa7dd141f1b8dcf35e6771ce27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:39.129951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.130575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.132159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1162/2347] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:39 2022] DELETE /identity/v3/projects/259ca9aa7dd141f1b8dcf35e6771ce27 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:39.136339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:39.147229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258da0a-5ce0-4325-9205-6dcca0587a13 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:39.202110 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:39.202740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.203016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.203287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] PATH_INFO: `/v3/users/16ee6f072ac04419a5a842a80201855a` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.204426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ee6f072ac04419a5a842a80201855a)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:39.206346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:39.239576 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:39.253227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ee6f072ac04419a5a842a80201855a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.253865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ee6f072ac04419a5a842a80201855a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.265313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ee6f072ac04419a5a842a80201855a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.273283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ee6f072ac04419a5a842a80201855a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.273889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-5799708f-e2ce-4281-8db4-738836a5048e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ee6f072ac04419a5a842a80201855a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.286275 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1186/2348] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:39 2022] DELETE /identity/v3/users/16ee6f072ac04419a5a842a80201855a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:39.561645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:39.563059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:39.577056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511f9f-58b6-42d3-9262-5e2ff8465c3c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:39.636154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:39.636782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.637068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.637340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] PATH_INFO: `/v3/projects/fc1bc832f352449d97ca9f1fc3732dd1` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.638465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1bc832f352449d97ca9f1fc3732dd1)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:39.640454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:39.641843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:39.687657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1bc832f352449d97ca9f1fc3732dd1', 'request_id': 'req-b5b79627-4726-4433-8f8d-0df05d6f9d87'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.693843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1bc832f352449d97ca9f1fc3732dd1', 'request_id': 'req-b5b79627-4726-4433-8f8d-0df05d6f9d87'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.700960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1bc832f352449d97ca9f1fc3732dd1', 'request_id': 'req-b5b79627-4726-4433-8f8d-0df05d6f9d87'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.711539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] The token cache is being invalidate because project fc1bc832f352449d97ca9f1fc3732dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:39.711832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.712476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b5b79627-4726-4433-8f8d-0df05d6f9d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:39.713965 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1163/2349] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:39 2022] DELETE /identity/v3/projects/fc1bc832f352449d97ca9f1fc3732dd1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:39.718865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.719324 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.719464 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.740531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:39.741755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:39.799235 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1187/2350] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:39.807770 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.807994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.808349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.828975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:39.830172 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:39.838040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1164/2351] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:39.842279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:39.852886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572c8fd-2f5f-4c67-972b-3fc59ba1136d None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:39.857434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:39.858029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.858308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.858578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.859217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:39.859577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:39.861199 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:39.873158 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1188/2352] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:39.877168 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:39.886236 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00595a73-62a2-4b17-a14d-0487e695f98a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:39.891935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:39.892553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:39.892997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:39.893152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:39.893695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:39.896391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:39.927241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1165/2353] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:39 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:39.931146 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:39.941341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ffa9-d45c-4153-82c5-dc10fd538008 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:39.999315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:39.999954 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.000231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.000504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.001136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.003075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.027979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1189/2354] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:39 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:40.029131 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.040006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7d049-aa19-4cfe-ac0e-899b36aeb24a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.044859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.045453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.045739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.046010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.046653 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.048348 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.059050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1166/2355] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:40.063565 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.074300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ea1e3-fbb7-41de-8413-025c0064ed40 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.078962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d972b4-e03c-4e6e-8d4e-6496ef64977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.079662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d972b4-e03c-4e6e-8d4e-6496ef64977b admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.079928 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d972b4-e03c-4e6e-8d4e-6496ef64977b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.080325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d972b4-e03c-4e6e-8d4e-6496ef64977b admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.080969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d972b4-e03c-4e6e-8d4e-6496ef64977b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.083156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d972b4-e03c-4e6e-8d4e-6496ef64977b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.094234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1190/2356] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:40.099691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.109778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11939f5-d681-42f4-aed9-98007b599759 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.114560 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.115206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.115537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.115798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] PATH_INFO: `/v3/projects/9f562770a866471fb7d111e8330848fa/users/37e1c9c2dfb741f4b2239ece3555c0b8/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.130323 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f562770a866471fb7d111e8330848fa, user_id=37e1c9c2dfb741f4b2239ece3555c0b8, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.133000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.146305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1167/2357] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:40 2022] PUT /identity/v3/projects/9f562770a866471fb7d111e8330848fa/users/37e1c9c2dfb741f4b2239ece3555c0b8/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:40.157644 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608331c-691b-4237-9631-188af5379b8f None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.157979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608331c-691b-4237-9631-188af5379b8f None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.158278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608331c-691b-4237-9631-188af5379b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.184641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:40.187973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-9608331c-691b-4237-9631-188af5379b8f None None] MFA Rules not processed for user `37e1c9c2dfb741f4b2239ece3555c0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:40.189752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9608331c-691b-4237-9631-188af5379b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:40.260326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1191/2358] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:40.264733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.326016 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462eb7f-236b-48ac-9bb1-3ae1a01252ed admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.330548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.331137 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.331423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.331707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.332985 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.334881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.361739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1168/2359] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:40 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:40.365955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608331c-691b-4237-9631-188af5379b8f None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.376465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608331c-691b-4237-9631-188af5379b8f None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.432261 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.432887 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.433164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.433434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.434054 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.436020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.456805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1192/2360] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:40 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:40.461387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.471538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc7ee0-82be-4ed3-9727-0ad0a88c7f11 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.476144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.476732 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.477010 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.477309 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.477945 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.479622 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.484915 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:40.491620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1169/2361] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:40.495654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.506139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570c3-4090-4e99-8cdb-2acddf51d423 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.510824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.511532 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.511814 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.512087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] PATH_INFO: `/v3/projects/7c8b8f000c4f462a874037352f702046/users/8f9bce24cfb742259cee49d3cf1a36f4/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.526769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8b8f000c4f462a874037352f702046, user_id=8f9bce24cfb742259cee49d3cf1a36f4, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.529452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.542307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1193/2362] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:40 2022] PUT /identity/v3/projects/7c8b8f000c4f462a874037352f702046/users/8f9bce24cfb742259cee49d3cf1a36f4/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:40.546193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.557250 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350aa4-4d39-459a-882e-1690a4512da0 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.613232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b48e6-d464-4d10-a3c2-5b319dc19aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.614438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b48e6-d464-4d10-a3c2-5b319dc19aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.614695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b48e6-d464-4d10-a3c2-5b319dc19aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.614995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b48e6-d464-4d10-a3c2-5b319dc19aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.615811 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b48e6-d464-4d10-a3c2-5b319dc19aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.617844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b48e6-d464-4d10-a3c2-5b319dc19aa6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.628029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1170/2363] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:40.632144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.642486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fb1a-8e6b-4a70-b675-9369d2796e3d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.647930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.648571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.648849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.649120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] PATH_INFO: `/v3/projects/7c8b8f000c4f462a874037352f702046/users/8f9bce24cfb742259cee49d3cf1a36f4/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.651050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8b8f000c4f462a874037352f702046, user_id=8f9bce24cfb742259cee49d3cf1a36f4, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.653713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.664177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1194/2364] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:40 2022] PUT /identity/v3/projects/7c8b8f000c4f462a874037352f702046/users/8f9bce24cfb742259cee49d3cf1a36f4/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:40.674253 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.674534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.674809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.703898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] MFA Rules not processed for user `8f9bce24cfb742259cee49d3cf1a36f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:40.705839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:40.778127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1171/2365] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:40.790182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.792295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:40.848987 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ead3da-c9b1-416e-bee2-cbabdfe77f2f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.852609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3f644-9ccb-4502-bd0e-cf7db399af11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.853206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f644-9ccb-4502-bd0e-cf7db399af11 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.853480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f644-9ccb-4502-bd0e-cf7db399af11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.853748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3f644-9ccb-4502-bd0e-cf7db399af11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.862637 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3f644-9ccb-4502-bd0e-cf7db399af11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.864743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3f644-9ccb-4502-bd0e-cf7db399af11 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:40.868583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:40.875835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1195/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:40.907933 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:40.973100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e393-65dc-49e6-8653-c3f70d92d099 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:40.977708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:40.978325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:40.978601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:40.978914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] PATH_INFO: `/v3/users/37e1c9c2dfb741f4b2239ece3555c0b8` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:40.980012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e1c9c2dfb741f4b2239ece3555c0b8)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:40.981929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:41.006078 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:41.030879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e1c9c2dfb741f4b2239ece3555c0b8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.038122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e1c9c2dfb741f4b2239ece3555c0b8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.049582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e1c9c2dfb741f4b2239ece3555c0b8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.050267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e1c9c2dfb741f4b2239ece3555c0b8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.058364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e1c9c2dfb741f4b2239ece3555c0b8'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.064647 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1172/2367] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:40 2022] DELETE /identity/v3/users/37e1c9c2dfb741f4b2239ece3555c0b8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:41.069220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:41.069507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:41.069782 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:41.088583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:41.089906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:41.152346 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1196/2368] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:19:41.165405 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:41.167161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:41.238342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea97de-2b92-42f9-88c8-25d48e768d1e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:41.242626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:41.243293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:41.243603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:41.244072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:41.256006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:41.257441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:41.269699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1173/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:41.800892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:41.802438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:41.814564 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ff588-3d98-4ffc-9b82-381beadd5157 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:41.819783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:41.820486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:41.820826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:41.821163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] PATH_INFO: `/v3/projects/9f562770a866471fb7d111e8330848fa` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:41.822343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f562770a866471fb7d111e8330848fa)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:41.824606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:41.869490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f562770a866471fb7d111e8330848fa', 'request_id': 'req-9ea720ea-cff1-4811-ba67-b4069df4b7f3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.875457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f562770a866471fb7d111e8330848fa', 'request_id': 'req-9ea720ea-cff1-4811-ba67-b4069df4b7f3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.883820 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f562770a866471fb7d111e8330848fa', 'request_id': 'req-9ea720ea-cff1-4811-ba67-b4069df4b7f3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.893573 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] The token cache is being invalidate because project 9f562770a866471fb7d111e8330848fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:41.893856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.894733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:41.896995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1197/2370] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:41 2022] DELETE /identity/v3/projects/9f562770a866471fb7d111e8330848fa => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:41.901109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:41.911684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3e76-6ac1-4e21-b0ef-013f51ed1952 service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:41.966288 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:41.966908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:41.967186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:41.967488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] PATH_INFO: `/v3/users/8f9bce24cfb742259cee49d3cf1a36f4` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:41.968587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9bce24cfb742259cee49d3cf1a36f4)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:41.970499 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.015148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:42.016857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9bce24cfb742259cee49d3cf1a36f4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.026557 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9bce24cfb742259cee49d3cf1a36f4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.038890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9bce24cfb742259cee49d3cf1a36f4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.039594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9bce24cfb742259cee49d3cf1a36f4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.046866 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-d7692900-1d95-4d7b-a09e-0780abe9cb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9bce24cfb742259cee49d3cf1a36f4'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.052780 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1174/2371] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:41 2022] DELETE /identity/v3/users/8f9bce24cfb742259cee49d3cf1a36f4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:19:42.323737 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.327217 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:42.344664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea720ea-cff1-4811-ba67-b4069df4b7f3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.413023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.413650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.413929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.414201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] PATH_INFO: `/v3/projects/7c8b8f000c4f462a874037352f702046` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.415370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8b8f000c4f462a874037352f702046)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.417380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.442795 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:42.464674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8b8f000c4f462a874037352f702046', 'request_id': 'req-c57619e7-0567-4166-ae24-63db2f6313aa'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.470543 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8b8f000c4f462a874037352f702046', 'request_id': 'req-c57619e7-0567-4166-ae24-63db2f6313aa'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.477526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8b8f000c4f462a874037352f702046', 'request_id': 'req-c57619e7-0567-4166-ae24-63db2f6313aa'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.487482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] The token cache is being invalidate because project 7c8b8f000c4f462a874037352f702046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:42.487768 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.488391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-c57619e7-0567-4166-ae24-63db2f6313aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:42.490370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1198/2372] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:42 2022] DELETE /identity/v3/projects/7c8b8f000c4f462a874037352f702046 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:42.495328 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144075-7a8f-477f-9486-0f15a94569be None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.495650 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144075-7a8f-477f-9486-0f15a94569be None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.495952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144075-7a8f-477f-9486-0f15a94569be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.515976 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-58144075-7a8f-477f-9486-0f15a94569be None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:42.517107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-58144075-7a8f-477f-9486-0f15a94569be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:42.577020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1175/2373] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:42.584917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.585201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.585473 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.605395 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:42.606591 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:42.615278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1199/2374] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:42.620178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144075-7a8f-477f-9486-0f15a94569be None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.629610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144075-7a8f-477f-9486-0f15a94569be None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.634206 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.634798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.635074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.635345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.636060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:42.636356 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.637949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.649661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1176/2375] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:19:42.654112 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.664350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247cf8-0843-4d9c-bfa0-87a9f9bf6384 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.668933 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.669522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.669798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.670064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.670808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.672732 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.699706 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1200/2376] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:42 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:42.703818 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.713685 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0eab96-07db-40f9-9898-848343cda9d3 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.769788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.770320 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.770601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.770896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.771555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.773480 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.794441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1177/2377] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:42 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:42.798708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.809865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1297d8-d384-4288-9382-527a9d167a25 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.814552 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.815147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.815455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.815729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.816374 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.818042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.827726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1201/2378] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:42.831644 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.841867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648919c-677f-41be-9338-3ee4397a8133 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.846774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd76e-7f72-494c-8e00-077b72b84635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.847374 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd76e-7f72-494c-8e00-077b72b84635 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.847683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd76e-7f72-494c-8e00-077b72b84635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.848472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd76e-7f72-494c-8e00-077b72b84635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.849113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fd76e-7f72-494c-8e00-077b72b84635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.850892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fd76e-7f72-494c-8e00-077b72b84635 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.862498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1178/2379] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:19:42.867691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:42.878477 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1c97-59e6-4836-9723-1cda9f302381 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:42.884420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:42.885239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.885561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.885832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] PATH_INFO: `/v3/projects/fb48628b1d5248789f0b88ae67f87599/users/b66e9bb6feb84246a39080cd4d7e619c/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.904656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb48628b1d5248789f0b88ae67f87599, user_id=b66e9bb6feb84246a39080cd4d7e619c, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:42.907362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:42.920951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1202/2380] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:42 2022] PUT /identity/v3/projects/fb48628b1d5248789f0b88ae67f87599/users/b66e9bb6feb84246a39080cd4d7e619c/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:42.932149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:42.932639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:42.932772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:42.960415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] MFA Rules not processed for user `b66e9bb6feb84246a39080cd4d7e619c`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:42.961663 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:42.979540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:43.028606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1179/2381] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:43.033082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.093400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6f28-f731-49d7-8279-05fe6c81d1ba admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.098670 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.099268 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.099569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.099853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.100462 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.102348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.127735 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1203/2382] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:43 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:43.131905 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.143551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ed0b-f960-4418-ade4-a0f9ff9bef53 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.199643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.200246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.200529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.200804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.201450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.203367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.227815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1180/2383] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:43 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:19:43.230416 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.240654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f974b8-6860-496f-8180-63230f6d7ea4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.245201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.245794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.246073 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.246344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.247014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.248630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.259372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1204/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:43.263198 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.273857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f3829-2f1c-4f0a-b783-3eeed363124c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.278464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98be87-150c-4730-bb35-60d2fe682145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.279105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98be87-150c-4730-bb35-60d2fe682145 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.279327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98be87-150c-4730-bb35-60d2fe682145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.279639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98be87-150c-4730-bb35-60d2fe682145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.280285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98be87-150c-4730-bb35-60d2fe682145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.281865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98be87-150c-4730-bb35-60d2fe682145 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.291661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1181/2385] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:43.295423 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.305092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c61f6-5a02-4265-8331-73e979767839 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.309701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.310307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.310584 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.310855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] PATH_INFO: `/v3/projects/868dd7b5c29145289b69016f32e81136/users/9f46a6cce9bc47f3846b2da3f7ef1e13/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.325559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868dd7b5c29145289b69016f32e81136, user_id=9f46a6cce9bc47f3846b2da3f7ef1e13, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.328276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.336837 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:43.342609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1205/2386] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:43 2022] PUT /identity/v3/projects/868dd7b5c29145289b69016f32e81136/users/9f46a6cce9bc47f3846b2da3f7ef1e13/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:43.352857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.353147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.353477 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.381373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] MFA Rules not processed for user `9f46a6cce9bc47f3846b2da3f7ef1e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:43.382645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:43.453497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.453889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1182/2387] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:43.518206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857b838-a21f-49f7-aebc-cdf242508d84 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.524142 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.524758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.525141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.525299 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.525952 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.528079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.559262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1206/2388] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:43 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:19:43.560443 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.571551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21694a7-3b42-4ec3-a889-a2b51dca8618 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.595569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:43.628573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.629174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.629967 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.630237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.630860 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.632882 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.653679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1183/2389] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:43 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:43.657894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.668156 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f5ad8-761c-4e1d-8fd7-5960f46bebaf admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.672800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.673391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.673681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.673946 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.674582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.676772 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.687273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1207/2390] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:43.691396 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.703074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b80e3-66d2-4304-9c7d-d4323af84ba7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.707893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.708543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.708870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.709143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] PATH_INFO: `/v3/projects/6224fa7ccae8450a9dcbe27e0dad19b9/users/bbf9c6bd9a9b42e6bcc79fb9288830e0/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.725639 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224fa7ccae8450a9dcbe27e0dad19b9, user_id=bbf9c6bd9a9b42e6bcc79fb9288830e0, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.728524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.744357 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1184/2391] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:43 2022] PUT /identity/v3/projects/6224fa7ccae8450a9dcbe27e0dad19b9/users/bbf9c6bd9a9b42e6bcc79fb9288830e0/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:43.748362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.759024 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ed5d5-10c6-4006-a276-a23379bba413 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.818575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a000964-9e2a-4e57-8b71-e092614a5059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.819188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000964-9e2a-4e57-8b71-e092614a5059 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.819479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000964-9e2a-4e57-8b71-e092614a5059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.819755 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000964-9e2a-4e57-8b71-e092614a5059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.820400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a000964-9e2a-4e57-8b71-e092614a5059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.822002 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a000964-9e2a-4e57-8b71-e092614a5059 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.831840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1208/2392] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:43.836104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.846255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bf95f-9a75-496b-8fe4-4bbc16636e13 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:43.850934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:43.851612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.851894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.852166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] PATH_INFO: `/v3/projects/6224fa7ccae8450a9dcbe27e0dad19b9/users/bbf9c6bd9a9b42e6bcc79fb9288830e0/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.854113 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224fa7ccae8450a9dcbe27e0dad19b9, user_id=bbf9c6bd9a9b42e6bcc79fb9288830e0, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:43.856791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:43.867240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1185/2393] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:43 2022] PUT /identity/v3/projects/6224fa7ccae8450a9dcbe27e0dad19b9/users/bbf9c6bd9a9b42e6bcc79fb9288830e0/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:43.878064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:43.878379 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:43.878641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:43.906840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] MFA Rules not processed for user `bbf9c6bd9a9b42e6bcc79fb9288830e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:43.908085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:43.966927 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:43.978266 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1209/2394] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:43.990160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:43.992037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:44.052000 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1949-ef9d-4ed6-a6a3-8dd25c614d02 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:44.055542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:44.056167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:44.056447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:44.056725 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:44.065813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:44.067249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:44.076839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1186/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:44.119228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:44.120668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:44.132463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2b8dc-9c58-4833-9678-7a7b55976dc5 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:44.136088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde3a74-4ef5-4304-8d4f-f44ce302fc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:44.136683 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde3a74-4ef5-4304-8d4f-f44ce302fc59 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:44.136967 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde3a74-4ef5-4304-8d4f-f44ce302fc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:44.137238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde3a74-4ef5-4304-8d4f-f44ce302fc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:44.194175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde3a74-4ef5-4304-8d4f-f44ce302fc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:44.195650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde3a74-4ef5-4304-8d4f-f44ce302fc59 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:44.204472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1210/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:44.580154 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:44.581569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:44.646399 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f79d4f-0f2f-417e-8674-3e7c10dde812 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:44.650943 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:44.651588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:44.651867 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:44.652138 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] PATH_INFO: `/v3/users/e296aabbd3f84058b803e1d42dce0a97` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:44.653242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e296aabbd3f84058b803e1d42dce0a97)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:44.655151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:44.677659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:44.700977 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e296aabbd3f84058b803e1d42dce0a97'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:44.708597 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e296aabbd3f84058b803e1d42dce0a97'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:44.720875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e296aabbd3f84058b803e1d42dce0a97'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:44.721572 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e296aabbd3f84058b803e1d42dce0a97'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:44.731931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e296aabbd3f84058b803e1d42dce0a97'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:44.738080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1187/2397] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:44 2022] DELETE /identity/v3/users/e296aabbd3f84058b803e1d42dce0a97 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:44.743173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:44.743486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:44.743785 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:44.763138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:44.764370 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:44.820925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1211/2398] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:44.830448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:44.831935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:44.888012 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb78e7-56c2-4d0e-a82b-fc46be5a7061 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:44.891603 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fdc95-7584-4a5d-a6e3-414371a97a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:44.892193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fdc95-7584-4a5d-a6e3-414371a97a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:44.892469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fdc95-7584-4a5d-a6e3-414371a97a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:44.892736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fdc95-7584-4a5d-a6e3-414371a97a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:44.901601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fdc95-7584-4a5d-a6e3-414371a97a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:44.903014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fdc95-7584-4a5d-a6e3-414371a97a86 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:44.912671 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1188/2399] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:45.175541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.176999 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:45.189113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775522d0-93ff-453f-9bdd-3a9faa8036d3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.193684 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.194315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.194590 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.194861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] PATH_INFO: `/v3/projects/67a5c74c86a84494b0abff26f0fd8dba` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.196005 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a5c74c86a84494b0abff26f0fd8dba)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.197910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.243762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a5c74c86a84494b0abff26f0fd8dba', 'request_id': 'req-8b2d1921-bb23-43ee-865e-cfcb338ed209'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:45.249754 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a5c74c86a84494b0abff26f0fd8dba', 'request_id': 'req-8b2d1921-bb23-43ee-865e-cfcb338ed209'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:45.256978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a5c74c86a84494b0abff26f0fd8dba', 'request_id': 'req-8b2d1921-bb23-43ee-865e-cfcb338ed209'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:45.267695 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] The token cache is being invalidate because project 67a5c74c86a84494b0abff26f0fd8dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:45.267981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:45.268622 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-8b2d1921-bb23-43ee-865e-cfcb338ed209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:45.270864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1212/2400] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:45 2022] DELETE /identity/v3/projects/67a5c74c86a84494b0abff26f0fd8dba => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:45.275721 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.276178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.276292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.296139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:45.297349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:45.355090 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1189/2401] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:45.362816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.363104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.363417 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.382442 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:45.383681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:45.391478 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1213/2402] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:19:45.396341 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.405804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bfaf4-93cd-4e72-8933-9eaf014a7134 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.410371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.411601 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.411885 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.412170 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.412812 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:45.413118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.414718 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.426058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1190/2403] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:45.430209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.439387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d12bf-b69c-4b91-af26-aff0ccea05df None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.443943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.444526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.444826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.445092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.445719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.447608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.452750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:45.475925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1214/2404] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:45 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:45.481074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.491594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4570a-7d69-4c64-8411-93a146ebaf10 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.520304 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:45.548824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.549427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.549714 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.549991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.550632 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.553272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.574361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1191/2405] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:45 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:45.578517 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.588958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe45a0f-ae1c-44b9-998a-b7d9ba9ad5f5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.593730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.594333 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.594613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.594893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.595575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.597189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.611459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1215/2406] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:45.612994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.626886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9dd3-b83a-4368-96e0-16da3400f01b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.633621 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41abadb-b9d4-4735-b39b-933e692df75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.633829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41abadb-b9d4-4735-b39b-933e692df75e admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.634112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41abadb-b9d4-4735-b39b-933e692df75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.634387 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41abadb-b9d4-4735-b39b-933e692df75e admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.635036 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41abadb-b9d4-4735-b39b-933e692df75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.636682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41abadb-b9d4-4735-b39b-933e692df75e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.654266 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1192/2407] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:45.658765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.670454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967cddf-09f1-44d3-a28c-99fd7a136de0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.675206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.675972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.676305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.677147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] PATH_INFO: `/v3/projects/f73138ebccd74dca86893daec5c4c567/users/ada515e6385f4dd4890a30683f059567/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.694465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73138ebccd74dca86893daec5c4c567, user_id=ada515e6385f4dd4890a30683f059567, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.698019 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.723988 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1216/2408] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:45 2022] PUT /identity/v3/projects/f73138ebccd74dca86893daec5c4c567/users/ada515e6385f4dd4890a30683f059567/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:45.781008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.781296 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.781571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.813532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] MFA Rules not processed for user `ada515e6385f4dd4890a30683f059567`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:45.814924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:45.884422 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1193/2409] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:45.897682 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:45.899490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:45.969426 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34de8d-4f7c-496b-bbaa-3f734e6ebe2f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:45.973765 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636bef-3b8e-4b88-8139-3da551e48199 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc9d2d85fbd449c86ea50f1d46ce009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:45.974378 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636bef-3b8e-4b88-8139-3da551e48199 service glance] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:45.974654 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636bef-3b8e-4b88-8139-3da551e48199 service glance] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:45.974918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636bef-3b8e-4b88-8139-3da551e48199 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:45.984062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636bef-3b8e-4b88-8139-3da551e48199 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:45.985506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636bef-3b8e-4b88-8139-3da551e48199 service glance] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:45.996364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1217/2410] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:19:47.123100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:47.124676 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:47.189490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ea98c-10c8-4c56-95b2-e2fee2c7e8cd None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:47.194773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:47.195421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:47.195708 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:47.195980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] PATH_INFO: `/v3/users/b66e9bb6feb84246a39080cd4d7e619c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:47.197092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66e9bb6feb84246a39080cd4d7e619c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:47.199029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:47.242390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:47.247877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66e9bb6feb84246a39080cd4d7e619c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:47.256361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66e9bb6feb84246a39080cd4d7e619c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:47.268842 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66e9bb6feb84246a39080cd4d7e619c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:47.269588 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66e9bb6feb84246a39080cd4d7e619c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:47.277850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66e9bb6feb84246a39080cd4d7e619c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:47.283700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1194/2411] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:47 2022] DELETE /identity/v3/users/b66e9bb6feb84246a39080cd4d7e619c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:47.288259 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:47.288743 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:47.288861 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:47.307868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:47.309102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:47.368876 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1218/2412] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:47.378541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:47.379988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:47.443283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230000-5c36-4b7b-9703-7b5bb9a66c4a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:47.447181 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:47.447935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:47.448292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:47.448638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:47.458651 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:47.460110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:47.469831 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1195/2413] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:48.007279 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:48.008776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:48.023178 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994f1f-d613-4cad-9f1f-75d3ff900cc8 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:48.028757 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:48.029470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:48.029752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:48.030020 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] PATH_INFO: `/v3/projects/fb48628b1d5248789f0b88ae67f87599` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:48.031153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb48628b1d5248789f0b88ae67f87599)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:48.033962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:48.084139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb48628b1d5248789f0b88ae67f87599', 'request_id': 'req-4d9edf06-9e2b-493d-9094-0acfab6bcea7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.085224 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:48.091939 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb48628b1d5248789f0b88ae67f87599', 'request_id': 'req-4d9edf06-9e2b-493d-9094-0acfab6bcea7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.099685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb48628b1d5248789f0b88ae67f87599', 'request_id': 'req-4d9edf06-9e2b-493d-9094-0acfab6bcea7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.109845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] The token cache is being invalidate because project fb48628b1d5248789f0b88ae67f87599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:48.110143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.110787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.112313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1219/2414] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:48 2022] DELETE /identity/v3/projects/fb48628b1d5248789f0b88ae67f87599 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:48.116656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:48.126635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52357-63d8-496c-94b7-a8ee3991bd7d service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:48.185189 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:48.185809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:48.186082 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:48.186351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] PATH_INFO: `/v3/users/9f46a6cce9bc47f3846b2da3f7ef1e13` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:48.187460 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f46a6cce9bc47f3846b2da3f7ef1e13)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:48.189379 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:48.235723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f46a6cce9bc47f3846b2da3f7ef1e13'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.243077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f46a6cce9bc47f3846b2da3f7ef1e13'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.248307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:48.258541 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f46a6cce9bc47f3846b2da3f7ef1e13'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.259295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f46a6cce9bc47f3846b2da3f7ef1e13'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.266583 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f46a6cce9bc47f3846b2da3f7ef1e13'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.273044 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1196/2415] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:48 2022] DELETE /identity/v3/users/9f46a6cce9bc47f3846b2da3f7ef1e13 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:48.546386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:48.547870 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:48.561805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9edf06-9e2b-493d-9094-0acfab6bcea7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:48.620424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:48.621057 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:48.621338 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:48.621613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] PATH_INFO: `/v3/projects/868dd7b5c29145289b69016f32e81136` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:48.622767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868dd7b5c29145289b69016f32e81136)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:48.624892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:48.672055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868dd7b5c29145289b69016f32e81136', 'request_id': 'req-53a7f23e-2fac-4793-861c-aae540ec5067'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.679042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868dd7b5c29145289b69016f32e81136', 'request_id': 'req-53a7f23e-2fac-4793-861c-aae540ec5067'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.687030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868dd7b5c29145289b69016f32e81136', 'request_id': 'req-53a7f23e-2fac-4793-861c-aae540ec5067'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.697871 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] The token cache is being invalidate because project 868dd7b5c29145289b69016f32e81136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:48.698157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.698783 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.700314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1220/2416] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:48 2022] DELETE /identity/v3/projects/868dd7b5c29145289b69016f32e81136 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:48.704391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:48.705759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:48.719562 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a41024-d485-49ca-972f-e9c5e40fc7f1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:48.777451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:48.777990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:48.778270 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:48.778535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] PATH_INFO: `/v3/users/bbf9c6bd9a9b42e6bcc79fb9288830e0` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:48.779700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf9c6bd9a9b42e6bcc79fb9288830e0)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:48.781657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:48.833285 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf9c6bd9a9b42e6bcc79fb9288830e0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.840222 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf9c6bd9a9b42e6bcc79fb9288830e0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.852589 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf9c6bd9a9b42e6bcc79fb9288830e0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.853248 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf9c6bd9a9b42e6bcc79fb9288830e0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.860717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-abf8b9e9-b3cf-4818-a47c-d5061a8aebe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf9c6bd9a9b42e6bcc79fb9288830e0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:48.868069 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1197/2417] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:48 2022] DELETE /identity/v3/users/bbf9c6bd9a9b42e6bcc79fb9288830e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:19:49.159064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.160575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:49.175625 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f23e-2fac-4793-861c-aae540ec5067 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.236406 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.237038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.237331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.237601 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] PATH_INFO: `/v3/projects/6224fa7ccae8450a9dcbe27e0dad19b9` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.238723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6224fa7ccae8450a9dcbe27e0dad19b9)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.240687 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.251762 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:49.292513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6224fa7ccae8450a9dcbe27e0dad19b9', 'request_id': 'req-1ff0c726-e482-4721-afb0-640bf16ce751'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:49.299134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6224fa7ccae8450a9dcbe27e0dad19b9', 'request_id': 'req-1ff0c726-e482-4721-afb0-640bf16ce751'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:49.306805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6224fa7ccae8450a9dcbe27e0dad19b9', 'request_id': 'req-1ff0c726-e482-4721-afb0-640bf16ce751'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:49.317580 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] The token cache is being invalidate because project 6224fa7ccae8450a9dcbe27e0dad19b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:49.317872 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:49.318492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-1ff0c726-e482-4721-afb0-640bf16ce751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:49.320010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1221/2418] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:49 2022] DELETE /identity/v3/projects/6224fa7ccae8450a9dcbe27e0dad19b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:49.325849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.326366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.326366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.347350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:49.348656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:49.400344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:49.410008 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1198/2419] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:49.418583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.418866 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.419141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.438807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:49.440061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:49.448469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1222/2420] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:49.452673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.463023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45be72-480c-4721-a53c-682802a44a27 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.467584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.468183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.468461 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.468730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.469363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:49.469689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.471274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.482763 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1199/2421] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:49.487451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.497116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d3d7-fbc8-4d42-bd80-6596f6e5e9b6 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.501984 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.502587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.502856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.503120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.503790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.506176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.533778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1223/2422] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:49.537756 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.547772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98949-070a-4ed7-bf50-3844852374a7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.611602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.612221 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.612498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.612771 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.613417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.615361 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.636117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1200/2423] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:49 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:49.640170 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.651483 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae63f27-8de2-46a9-8731-0d0bbb1e36c4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.656001 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.656593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.656868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.657138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.657771 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.659352 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.669042 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1224/2424] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:49.673371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.684025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4df9d4-5841-423d-a054-5a951035b135 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.688620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceee83-04c1-4695-9117-68e7626d7a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.689219 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceee83-04c1-4695-9117-68e7626d7a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.689503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceee83-04c1-4695-9117-68e7626d7a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.689779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceee83-04c1-4695-9117-68e7626d7a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.690426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ceee83-04c1-4695-9117-68e7626d7a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.692070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ceee83-04c1-4695-9117-68e7626d7a92 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.703049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1201/2425] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:19:49.707690 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.718544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438ea34-b4e8-423c-9335-716d63702431 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.723463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.724117 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.724391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.724662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] PATH_INFO: `/v3/projects/7ce8b89e63b24896ac04726fdc424ea7/users/6c67d69997504e9db745c5227dbff307/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.741183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce8b89e63b24896ac04726fdc424ea7, user_id=6c67d69997504e9db745c5227dbff307, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.744139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.757906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1225/2426] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:49 2022] PUT /identity/v3/projects/7ce8b89e63b24896ac04726fdc424ea7/users/6c67d69997504e9db745c5227dbff307/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:49.769534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.769828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.770435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.797810 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] MFA Rules not processed for user `6c67d69997504e9db745c5227dbff307`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:49.799035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:49.865659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1202/2427] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:49.877535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:49.879182 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:49.936691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf24e44-84fc-4019-b3db-be1406726661 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:49.940979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607dcdc-4871-44c6-a08e-42cfc5526af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:49.941779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607dcdc-4871-44c6-a08e-42cfc5526af6 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:49.942060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607dcdc-4871-44c6-a08e-42cfc5526af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:49.942901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607dcdc-4871-44c6-a08e-42cfc5526af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:49.953399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607dcdc-4871-44c6-a08e-42cfc5526af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:49.954857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607dcdc-4871-44c6-a08e-42cfc5526af6 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:49.964129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1226/2428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:49.983740 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:50.043694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:50.050994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d39c6-d215-4ea3-9283-34a37ea6c3a6 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:50.056600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:50.057238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:50.057516 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:50.057788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] PATH_INFO: `/v3/users/6c67d69997504e9db745c5227dbff307` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:50.058909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c67d69997504e9db745c5227dbff307)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:50.060948 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:50.107527 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c67d69997504e9db745c5227dbff307'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.115124 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c67d69997504e9db745c5227dbff307'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.126900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c67d69997504e9db745c5227dbff307'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.127633 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c67d69997504e9db745c5227dbff307'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.136878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c67d69997504e9db745c5227dbff307'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.142930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1203/2429] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:49 2022] DELETE /identity/v3/users/6c67d69997504e9db745c5227dbff307 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:50.147781 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af405-906a-422c-9773-46b83a719fda None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:50.148085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af405-906a-422c-9773-46b83a719fda None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:50.148347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af405-906a-422c-9773-46b83a719fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:50.169024 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-a84af405-906a-422c-9773-46b83a719fda None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:50.170262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a84af405-906a-422c-9773-46b83a719fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:50.202397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:50.232307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1227/2430] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:50.242776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:50.244269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:50.300618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714946-68dd-428d-9c74-9429a446366f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:50.305017 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086c9ac-5ab7-4835-a711-3fc279e4ca28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:50.305337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086c9ac-5ab7-4835-a711-3fc279e4ca28 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:50.305611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086c9ac-5ab7-4835-a711-3fc279e4ca28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:50.305878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086c9ac-5ab7-4835-a711-3fc279e4ca28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:50.315074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086c9ac-5ab7-4835-a711-3fc279e4ca28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:50.316540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086c9ac-5ab7-4835-a711-3fc279e4ca28 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:50.326669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1204/2431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:50.693041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af405-906a-422c-9773-46b83a719fda None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:50.694635 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a84af405-906a-422c-9773-46b83a719fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:50.708650 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af405-906a-422c-9773-46b83a719fda None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:50.715714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:50.715714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:50.715714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:50.715714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] PATH_INFO: `/v3/projects/7ce8b89e63b24896ac04726fdc424ea7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:50.716176 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce8b89e63b24896ac04726fdc424ea7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:50.717862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:50.771457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce8b89e63b24896ac04726fdc424ea7', 'request_id': 'req-6971f8b2-835b-4775-87e8-8d2650e41db6'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.777726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce8b89e63b24896ac04726fdc424ea7', 'request_id': 'req-6971f8b2-835b-4775-87e8-8d2650e41db6'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.785563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce8b89e63b24896ac04726fdc424ea7', 'request_id': 'req-6971f8b2-835b-4775-87e8-8d2650e41db6'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.795916 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] The token cache is being invalidate because project 7ce8b89e63b24896ac04726fdc424ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:50.796204 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.796853 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6971f8b2-835b-4775-87e8-8d2650e41db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:50.798331 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1228/2432] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:50 2022] DELETE /identity/v3/projects/7ce8b89e63b24896ac04726fdc424ea7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:50.803272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:50.803598 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:50.803874 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:50.824231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:50.825450 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:50.885692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1205/2433] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:50.951845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:50.952041 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:50.952303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:50.971926 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:50.973137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:50.981500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1229/2434] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:50.985782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:50.997451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ebb2-1266-4c66-a5d2-fbdc1d059466 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.002116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.002716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.002997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.003272 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.003958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:51.004265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.005912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.018037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1206/2435] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:51.022944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:51.032329 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c36d4-bf17-4d18-a560-49b59244c712 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.038842 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.039482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.039760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.040027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.040661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.042583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.070686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1230/2436] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:51 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:51.074844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:51.081552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:51.085468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414057b-d47c-4d73-b076-3a862692040f admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.146265 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.147086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.147370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.147668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.148307 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.150291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.174648 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1207/2437] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:51 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:51.175976 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:51.186615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3c89-0c17-43c9-b99b-91de5ab6e3f3 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.191198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.191830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.192111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.192387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.193029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.194630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.205342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1231/2438] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:51.210091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:51.220577 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d10f1b-c44e-4e02-8bf6-8c38443dff4c admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.225716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd81ec3-174b-4682-9a03-e717a0d13bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.226311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81ec3-174b-4682-9a03-e717a0d13bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.226610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81ec3-174b-4682-9a03-e717a0d13bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.226883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81ec3-174b-4682-9a03-e717a0d13bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.227587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd81ec3-174b-4682-9a03-e717a0d13bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.229229 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd81ec3-174b-4682-9a03-e717a0d13bfd admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.239949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1208/2439] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:51.244593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:51.255361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34880fb-49e2-4054-bc47-59fadb413736 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.260034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.260686 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.260965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.261234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] PATH_INFO: `/v3/projects/d4c919d6bedc499182d5090dd76e92ad/users/381bc10a175841438e0a568ab7d98b80/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.277191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c919d6bedc499182d5090dd76e92ad, user_id=381bc10a175841438e0a568ab7d98b80, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.280214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.296168 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1232/2440] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:51 2022] PUT /identity/v3/projects/d4c919d6bedc499182d5090dd76e92ad/users/381bc10a175841438e0a568ab7d98b80/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:51.306337 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.306700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.306972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.335174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] MFA Rules not processed for user `381bc10a175841438e0a568ab7d98b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:51.336465 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:51.404991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1209/2441] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:51.416697 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:51.418386 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:51.476788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abacefb-f09e-4ff1-a13d-938a41ac59c8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:51.480469 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16096-262f-4f63-8799-28334c080548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:51.481069 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16096-262f-4f63-8799-28334c080548 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:51.481342 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16096-262f-4f63-8799-28334c080548 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:51.481633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16096-262f-4f63-8799-28334c080548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:51.490160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b16096-262f-4f63-8799-28334c080548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:51.491611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b16096-262f-4f63-8799-28334c080548 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:51.496018 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:51.500845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1233/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:54.580073 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:54.642081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394025-e58e-413c-8e08-95c150355bf4 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:54.647733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:54.648380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:54.648662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:54.648946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] PATH_INFO: `/v3/users/381bc10a175841438e0a568ab7d98b80` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:54.650077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381bc10a175841438e0a568ab7d98b80)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:54.652058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:54.665995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:54.700540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381bc10a175841438e0a568ab7d98b80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:54.707567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381bc10a175841438e0a568ab7d98b80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:54.720662 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381bc10a175841438e0a568ab7d98b80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:54.721392 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381bc10a175841438e0a568ab7d98b80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:54.734086 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381bc10a175841438e0a568ab7d98b80'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:54.741395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1210/2443] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:19:54 2022] DELETE /identity/v3/users/381bc10a175841438e0a568ab7d98b80 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:54.745981 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:54.746435 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:54.746597 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:54.766280 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:54.767620 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:54.828533 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1234/2444] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:54.839445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:54.840684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:54.914522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0e90a-4ce6-4362-9127-2d2090d3f6c9 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:54.918107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbfb38-b0b4-4def-9121-c6659bb001ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:54.918702 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbfb38-b0b4-4def-9121-c6659bb001ab service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:54.918980 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbfb38-b0b4-4def-9121-c6659bb001ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:54.919292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbfb38-b0b4-4def-9121-c6659bb001ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:54.932805 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbfb38-b0b4-4def-9121-c6659bb001ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:54.934256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbfb38-b0b4-4def-9121-c6659bb001ab service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:54.944496 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1211/2445] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:19:55.292664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.294427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:55.316703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da585f-4dd3-40a9-8e46-64c920770545 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.322003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.322632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.322914 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.323188 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] PATH_INFO: `/v3/projects/d4c919d6bedc499182d5090dd76e92ad` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.324368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c919d6bedc499182d5090dd76e92ad)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.326278 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.374664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c919d6bedc499182d5090dd76e92ad', 'request_id': 'req-768c1259-3cc2-4edc-8750-7a36af6e9adb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:55.381056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c919d6bedc499182d5090dd76e92ad', 'request_id': 'req-768c1259-3cc2-4edc-8750-7a36af6e9adb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:55.389099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c919d6bedc499182d5090dd76e92ad', 'request_id': 'req-768c1259-3cc2-4edc-8750-7a36af6e9adb'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:55.400748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] The token cache is being invalidate because project d4c919d6bedc499182d5090dd76e92ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:19:55.401034 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:55.401661 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-768c1259-3cc2-4edc-8750-7a36af6e9adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:19:55.403219 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1235/2446] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:19:55 2022] DELETE /identity/v3/projects/d4c919d6bedc499182d5090dd76e92ad => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:55.408132 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.408411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.408681 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.429568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:55.430749 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:55.489515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1212/2447] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:55.497385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.497677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.497959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.519787 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:55.521323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:55.529908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1236/2448] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:55.534227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.543942 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fedd2-60da-4f77-93a7-3a31aae2be21 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.548694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.549283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.549584 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.549864 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.550582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:19:55.551022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.552606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.567886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1213/2449] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:19:55.572583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.582032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61076f-ee54-4750-89eb-a9ecf7610b76 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.587339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.587962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.588238 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.588505 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.589131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.591014 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.618703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1237/2450] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:19:55 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:55.622726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.633332 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819803-8641-4f66-8f76-57d20a35bba6 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.652194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:55.693431 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.694585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.694893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.695162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.695839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.697787 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.719778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1214/2451] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:19:55 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:19:55.724033 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.734467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05644cf-8dcd-4086-9813-d4f0692b04ad admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.739127 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.739758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.740037 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.740307 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.741518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.743124 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.755472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1238/2452] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:55.758448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.769367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12cfe0-cd51-486e-b1f3-e272f00ea439 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.774488 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720375f-778b-4db1-8e8e-84285362fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.775105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720375f-778b-4db1-8e8e-84285362fe3a admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.775381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720375f-778b-4db1-8e8e-84285362fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.775707 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720375f-778b-4db1-8e8e-84285362fe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.776364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720375f-778b-4db1-8e8e-84285362fe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.777970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720375f-778b-4db1-8e8e-84285362fe3a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.788310 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1215/2453] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:19:55.792419 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.802332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278f98-62a3-428d-a0df-bebca5befb06 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:55.807607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:55.808250 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.808529 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.808805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] PATH_INFO: `/v3/projects/a7315cbaa94940759a676a4730efec43/users/1bf0cdbeb78b43af88328a9f9e8fcd14/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.824841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7315cbaa94940759a676a4730efec43, user_id=1bf0cdbeb78b43af88328a9f9e8fcd14, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:55.827559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:55.839944 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1239/2454] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:19:55 2022] PUT /identity/v3/projects/a7315cbaa94940759a676a4730efec43/users/1bf0cdbeb78b43af88328a9f9e8fcd14/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:19:55.851339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:55.851646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:55.851914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:55.879133 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] MFA Rules not processed for user `1bf0cdbeb78b43af88328a9f9e8fcd14`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:19:55.880358 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:55.952865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1216/2455] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:19:55.963895 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:19:55.965587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:19:55.987728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:56.024356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d0c4-aa31-4780-ab29-05f639c182f4 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:19:56.027977 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:19:56.028566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:19:56.028840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:19:56.029107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:19:56.037193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:19:56.038668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:19:56.047194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1240/2456] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:19:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:02.563679 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:02.565218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:02.624233 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bfed7-7cf2-465a-b5ad-1d279fb93821 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:02.627880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:02.628492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:02.628775 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:02.629049 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:02.631192 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:02.641300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:02.642743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:02.651539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1217/2457] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:02.723965 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:02.725393 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:02.738255 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c903-fcf4-4e90-bfc8-3fffa2870518 service cinder] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:02.741826 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:02.742421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:02.742698 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:02.742964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:02.744680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:02.833841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:02.835318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:02.856262 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1241/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:03.768587 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:03.777843 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7cf78-0892-4b92-9559-81982bd638bb service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:03.781582 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:03.782183 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:03.782464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:03.782736 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:03.784520 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:03.798760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:03.800241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:03.812178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1218/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:20:06.110689 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:06.179206 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0adc42-f358-4612-af45-7997752a6327 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:06.184447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:06.185080 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.185355 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.185626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] PATH_INFO: `/v3/users/1bf0cdbeb78b43af88328a9f9e8fcd14` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.186734 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf0cdbeb78b43af88328a9f9e8fcd14)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:06.188692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:06.189445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:06.198448 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002388-e4a9-4872-9a85-baefa86106dc service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:06.202047 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:06.202640 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.202920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.203193 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.204929 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:06.219903 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:06.221743 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d2562-772c-4ccf-9947-5ddd18499701 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:06.224855 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:06.234975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1219/2460] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 13:20:06.238800 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf0cdbeb78b43af88328a9f9e8fcd14'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.239490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf0cdbeb78b43af88328a9f9e8fcd14'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.252490 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf0cdbeb78b43af88328a9f9e8fcd14'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.261012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf0cdbeb78b43af88328a9f9e8fcd14'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.261676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf0cdbeb78b43af88328a9f9e8fcd14'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.274400 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1242/2461] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:06 2022] DELETE /identity/v3/users/1bf0cdbeb78b43af88328a9f9e8fcd14 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:06.278861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792669-29f8-478b-ba14-1826692235fa None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.279384 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792669-29f8-478b-ba14-1826692235fa None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.279695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792669-29f8-478b-ba14-1826692235fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.293385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:06.299894 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-1f792669-29f8-478b-ba14-1826692235fa None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:06.301104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1f792669-29f8-478b-ba14-1826692235fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:06.361075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1220/2462] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:06.370827 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:06.372268 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:06.427815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e308-024c-4f73-88e7-172fc8c9faf5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:06.431962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414f1d9-1193-4de5-89d4-02050187b832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:06.432561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414f1d9-1193-4de5-89d4-02050187b832 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.432836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414f1d9-1193-4de5-89d4-02050187b832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.433107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414f1d9-1193-4de5-89d4-02050187b832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.441905 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414f1d9-1193-4de5-89d4-02050187b832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:06.443323 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414f1d9-1193-4de5-89d4-02050187b832 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:06.453212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1243/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:06.723871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f792669-29f8-478b-ba14-1826692235fa None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:06.729606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-1f792669-29f8-478b-ba14-1826692235fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:06.742474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f792669-29f8-478b-ba14-1826692235fa None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:06.747968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:06.748701 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.749067 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.749415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] PATH_INFO: `/v3/projects/a7315cbaa94940759a676a4730efec43` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.750606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7315cbaa94940759a676a4730efec43)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:06.752637 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:06.802537 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7315cbaa94940759a676a4730efec43', 'request_id': 'req-2e794b47-faba-4944-a6d2-c158781963ef'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.809077 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7315cbaa94940759a676a4730efec43', 'request_id': 'req-2e794b47-faba-4944-a6d2-c158781963ef'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.816056 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7315cbaa94940759a676a4730efec43', 'request_id': 'req-2e794b47-faba-4944-a6d2-c158781963ef'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.826223 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] The token cache is being invalidate because project a7315cbaa94940759a676a4730efec43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:06.826514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.827144 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2e794b47-faba-4944-a6d2-c158781963ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:06.828664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1221/2464] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:06 2022] DELETE /identity/v3/projects/a7315cbaa94940759a676a4730efec43 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:06.833520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.833805 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.834082 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.854185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:06.855506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:06.914016 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1244/2465] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:20:06.922281 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.922566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.922838 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.942111 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:06.943299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:06.951032 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1222/2466] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:06.955050 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:06.965368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dfb0c-4927-4197-92a8-f75854a50513 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:06.970173 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:06.970799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:06.971102 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:06.971377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:06.973348 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:06.973645 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:06.975577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:06.991678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1245/2467] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:06.992783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:07.002152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abbf49-d73c-4536-a5da-5a14bf688398 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:07.006998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:07.007625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.007909 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.008182 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.008826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:07.012136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:07.056673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1223/2468] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:06 2022] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:20:07.057835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:07.068028 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffafd1-ee1f-4d6e-8dce-264b2acd1183 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:07.102075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:07.129514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:07.130157 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.130381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.130648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.131364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:07.134087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:07.157985 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1246/2469] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:07 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:07.162040 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:07.173451 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44eac-2b29-4c76-b0bd-e83c35c6252d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:07.178117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:07.178762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.179152 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.179449 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.180099 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:07.181696 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:07.191623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1224/2470] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:07.195888 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:07.207875 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd4b4a-a36a-4003-9be1-226a7f889bd7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:07.213994 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a357c-16a9-4c36-9f65-cd5a9ca7f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:07.214593 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a357c-16a9-4c36-9f65-cd5a9ca7f241 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.214918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a357c-16a9-4c36-9f65-cd5a9ca7f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.215196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a357c-16a9-4c36-9f65-cd5a9ca7f241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.215862 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a357c-16a9-4c36-9f65-cd5a9ca7f241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:07.217857 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a357c-16a9-4c36-9f65-cd5a9ca7f241 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:07.231164 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1247/2471] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:20:07.232411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:07.242635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea70422-beb9-44c0-9404-20e446b741bc admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:07.249091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:07.250041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.250643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.250991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] PATH_INFO: `/v3/projects/33c070ab2bc947d0802ba409993608c9/users/b8573dc705784a7bb2ea21a91f6f42c3/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.268435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c070ab2bc947d0802ba409993608c9, user_id=b8573dc705784a7bb2ea21a91f6f42c3, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:07.271720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:07.289391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1225/2472] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:07 2022] PUT /identity/v3/projects/33c070ab2bc947d0802ba409993608c9/users/b8573dc705784a7bb2ea21a91f6f42c3/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:07.300811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.301166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.301467 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.330733 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] MFA Rules not processed for user `b8573dc705784a7bb2ea21a91f6f42c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:07.332347 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:07.394892 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1248/2473] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:07.407199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:07.408954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:07.430161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:07.471778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba715bb6-7c90-4a20-8bdd-4726a5f4fbdb admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:07.475391 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca10b2b-dae1-4ad5-99d5-043847540b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:07.476022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca10b2b-dae1-4ad5-99d5-043847540b83 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:07.476300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca10b2b-dae1-4ad5-99d5-043847540b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:07.476569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca10b2b-dae1-4ad5-99d5-043847540b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:07.484988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca10b2b-dae1-4ad5-99d5-043847540b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:07.486423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca10b2b-dae1-4ad5-99d5-043847540b83 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:07.495303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1226/2474] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:11.819231 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:11.820691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:11.885293 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e25ca-a463-4403-ba75-a7d30264b8d9 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:11.889958 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:11.890616 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:11.890894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:11.891194 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] PATH_INFO: `/v3/users/ada515e6385f4dd4890a30683f059567` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:11.892460 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada515e6385f4dd4890a30683f059567)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:11.894373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:11.940722 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada515e6385f4dd4890a30683f059567'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:11.941392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada515e6385f4dd4890a30683f059567'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:11.942500 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:11.955794 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada515e6385f4dd4890a30683f059567'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:11.962828 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada515e6385f4dd4890a30683f059567'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:11.963495 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada515e6385f4dd4890a30683f059567'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:11.975449 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1249/2475] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:11 2022] DELETE /identity/v3/users/ada515e6385f4dd4890a30683f059567 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:11.980476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:11.980970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:11.981071 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:12.000157 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:12.001372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:12.059051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1227/2476] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:12.068680 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:12.070091 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:12.126177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d4e2f-4b4a-4bb0-8749-494564b55772 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:12.129779 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:12.130376 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:12.130656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:12.130932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:12.139879 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:12.141314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:12.152586 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1250/2477] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:12.434790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:12.436194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:12.450354 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b082900-150d-4cac-9e1a-26ac9599a92c None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:12.455238 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:12.455964 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:12.456314 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:12.456656 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] PATH_INFO: `/v3/projects/f73138ebccd74dca86893daec5c4c567` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:12.457863 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73138ebccd74dca86893daec5c4c567)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:12.461904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:12.486568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:12.488604 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:12.504558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af860-df72-4ac6-bf0d-93ef723d5e0a service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:12.520435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73138ebccd74dca86893daec5c4c567', 'request_id': 'req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.528126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73138ebccd74dca86893daec5c4c567', 'request_id': 'req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.536698 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73138ebccd74dca86893daec5c4c567', 'request_id': 'req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.548923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] The token cache is being invalidate because project f73138ebccd74dca86893daec5c4c567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:12.549329 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.550091 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-0bd5ac97-8dc0-4b63-9b68-b7c0d8995b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.551799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1228/2478] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:12 2022] DELETE /identity/v3/projects/f73138ebccd74dca86893daec5c4c567 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:12.569885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:12.570553 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:12.570836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:12.571134 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] PATH_INFO: `/v3/users/b8573dc705784a7bb2ea21a91f6f42c3` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:12.573136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8573dc705784a7bb2ea21a91f6f42c3)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:12.575372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:12.639819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8573dc705784a7bb2ea21a91f6f42c3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.640626 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8573dc705784a7bb2ea21a91f6f42c3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.656810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8573dc705784a7bb2ea21a91f6f42c3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.680799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:12.684770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8573dc705784a7bb2ea21a91f6f42c3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.686079 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8573dc705784a7bb2ea21a91f6f42c3'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:12.707839 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1251/2479] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:12 2022] DELETE /identity/v3/users/b8573dc705784a7bb2ea21a91f6f42c3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:20:12.713213 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:12.713934 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:12.714533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:12.749949 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:12.751452 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:12.811042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:12.835042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1229/2480] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:12.844845 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:12.846836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:12.905420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad63b7-ad53-452d-bf4c-bb1f90f4b27f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:12.908950 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:12.909531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:12.909807 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:12.910104 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:12.919026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:12.920501 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:12.930022 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1252/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:13.207803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:13.209263 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:13.222052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f46e7-72c7-4f56-9c4f-a428f3947de1 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:13.226682 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:13.227319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:13.227638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:13.228454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] PATH_INFO: `/v3/projects/33c070ab2bc947d0802ba409993608c9` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:13.229593 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c070ab2bc947d0802ba409993608c9)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:13.232336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:13.278772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c070ab2bc947d0802ba409993608c9', 'request_id': 'req-77def2d6-de7f-43b8-9bce-fdd57c623b21'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:13.284792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c070ab2bc947d0802ba409993608c9', 'request_id': 'req-77def2d6-de7f-43b8-9bce-fdd57c623b21'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:13.292870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c070ab2bc947d0802ba409993608c9', 'request_id': 'req-77def2d6-de7f-43b8-9bce-fdd57c623b21'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:13.304350 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] The token cache is being invalidate because project 33c070ab2bc947d0802ba409993608c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:13.304695 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:13.305373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:13.307567 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1230/2482] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:13 2022] DELETE /identity/v3/projects/33c070ab2bc947d0802ba409993608c9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:22.925910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=32 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:23.301085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:25.706655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:25.715327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7a77-d6c1-48d5-9e36-a6d9c67f15c0 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:25.763354 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:25.763978 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:25.764252 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:25.764519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:25.766248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:25.826632 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:25.828106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:25.837575 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1253/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:28.972952 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:28.974444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:28.988794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def2d6-de7f-43b8-9bce-fdd57c623b21 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:28.995057 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:28.995726 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:28.996023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:28.996286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] PATH_INFO: `/v3/users/0b9ef1203b0b4af39dd66b252eace4d0` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:28.997425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9ef1203b0b4af39dd66b252eace4d0)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:28.999366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.048463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9ef1203b0b4af39dd66b252eace4d0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.055641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9ef1203b0b4af39dd66b252eace4d0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.068459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9ef1203b0b4af39dd66b252eace4d0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.069167 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9ef1203b0b4af39dd66b252eace4d0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.076549 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-fa38c4e4-73fc-4839-84a3-1242f2beca7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9ef1203b0b4af39dd66b252eace4d0'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.082779 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1231/2484] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:28 2022] DELETE /identity/v3/users/0b9ef1203b0b4af39dd66b252eace4d0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:29.252205 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.264371 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cce71-9515-416b-bbd8-92f7baad5ea1 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.320515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.321136 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.321410 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.321677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] PATH_INFO: `/v3/projects/4b0a0ce59f2d43eba7fd57aa2b4245de` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.322784 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0a0ce59f2d43eba7fd57aa2b4245de)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.324803 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.369616 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0a0ce59f2d43eba7fd57aa2b4245de', 'request_id': 'req-2bca98c8-cf21-454b-8560-af1e70e43310'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.371369 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:29.376556 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0a0ce59f2d43eba7fd57aa2b4245de', 'request_id': 'req-2bca98c8-cf21-454b-8560-af1e70e43310'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.383569 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0a0ce59f2d43eba7fd57aa2b4245de', 'request_id': 'req-2bca98c8-cf21-454b-8560-af1e70e43310'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.394130 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] The token cache is being invalidate because project 4b0a0ce59f2d43eba7fd57aa2b4245de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:29.394418 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.395053 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-2bca98c8-cf21-454b-8560-af1e70e43310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:29.396583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1254/2485] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:29 2022] DELETE /identity/v3/projects/4b0a0ce59f2d43eba7fd57aa2b4245de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:29.402386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.402668 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.402936 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.422529 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:29.423745 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:29.481256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1232/2486] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:20:29.488908 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.489197 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.489492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.509332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:29.511137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:29.518936 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1255/2487] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:29.523001 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.532850 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031156fa-f165-44cf-930d-bc40caaaa1b9 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.537318 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.537911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.538191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.538463 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.539139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:29.539454 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.541052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.552293 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1233/2488] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:29.556669 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.566692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd367e3-e732-4ba1-acc9-9d2cf055c6eb None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.571578 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.572177 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.573060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.573340 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.573969 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.575909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.601657 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1256/2489] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:29 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:29.605788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.615687 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9480-55fe-4181-92d6-a32ddeb1dae6 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.672339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.672871 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.673148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.673416 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.674027 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.675954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.684459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:29.698481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1234/2490] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:29 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:29.702728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.712948 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437590-9c31-4fc3-8b99-3b8da92938e8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.717667 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.718267 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.718549 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.718816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.719484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.721143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.731660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1257/2491] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:29.735717 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.746136 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927de1e8-b4b6-43a8-b85b-149d6f1b3a88 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.750683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e088-de3f-4f33-ba9e-763115710744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.751274 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e088-de3f-4f33-ba9e-763115710744 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.751729 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e088-de3f-4f33-ba9e-763115710744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.751924 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e088-de3f-4f33-ba9e-763115710744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.752526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e088-de3f-4f33-ba9e-763115710744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.754105 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e088-de3f-4f33-ba9e-763115710744 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.765571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1235/2492] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:29.769668 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.780193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97027ec-cdbf-40ee-9415-ff4278860fa0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:29.784925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:29.785577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.785858 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.786132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] PATH_INFO: `/v3/projects/555888f917234bd2b439d1465833bced/users/32ec7ce86ee248cfa1e11c457f3cf95c/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.801051 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555888f917234bd2b439d1465833bced, user_id=32ec7ce86ee248cfa1e11c457f3cf95c, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:29.803730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:29.816840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1258/2493] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:29 2022] PUT /identity/v3/projects/555888f917234bd2b439d1465833bced/users/32ec7ce86ee248cfa1e11c457f3cf95c/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:29.827730 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:29.828031 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:29.828290 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:29.856386 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] MFA Rules not processed for user `32ec7ce86ee248cfa1e11c457f3cf95c`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:29.857688 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:29.921269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1236/2494] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:20:29.933048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:29.934665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:30.006272 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3750-0fc3-4e1c-9be7-901c3dc40131 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:30.011850 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d781ad-c4d4-4359-9600-abddc2792112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:30.012448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d781ad-c4d4-4359-9600-abddc2792112 service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:30.012730 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d781ad-c4d4-4359-9600-abddc2792112 service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:30.013006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d781ad-c4d4-4359-9600-abddc2792112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:30.020589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d781ad-c4d4-4359-9600-abddc2792112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:30.022167 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d781ad-c4d4-4359-9600-abddc2792112 service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:30.031106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1259/2495] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:35.217570 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:35.275638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef37b-4cb5-44be-939e-e6d9c56040ef None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:35.280550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:35.281164 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:35.281441 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:35.281709 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] PATH_INFO: `/v3/users/32ec7ce86ee248cfa1e11c457f3cf95c` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:35.282809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ec7ce86ee248cfa1e11c457f3cf95c)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:35.284738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:35.328820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ec7ce86ee248cfa1e11c457f3cf95c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.335540 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ec7ce86ee248cfa1e11c457f3cf95c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.345859 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:35.348373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ec7ce86ee248cfa1e11c457f3cf95c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.349101 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ec7ce86ee248cfa1e11c457f3cf95c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.357571 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ec7ce86ee248cfa1e11c457f3cf95c'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.363371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1237/2496] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:35 2022] DELETE /identity/v3/users/32ec7ce86ee248cfa1e11c457f3cf95c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:35.367877 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:35.368334 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:35.368461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:35.386898 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:35.388148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:35.446036 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1260/2497] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:35.455672 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:35.457080 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:35.512551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247a28-a29d-4cc1-ba47-c6597cc13f01 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:35.516280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fad10-1266-47fd-8ae3-ae431e3c8911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:35.516872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fad10-1266-47fd-8ae3-ae431e3c8911 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:35.517148 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fad10-1266-47fd-8ae3-ae431e3c8911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:35.517442 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fad10-1266-47fd-8ae3-ae431e3c8911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:35.527053 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fad10-1266-47fd-8ae3-ae431e3c8911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:35.528453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fad10-1266-47fd-8ae3-ae431e3c8911 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:35.537550 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1238/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:35.810387 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:35.811931 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:35.819237 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:35.826385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68828dbd-5b48-47ee-b51e-6fecfef03c44 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:35.832589 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:35.833220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:35.833497 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:35.833767 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] PATH_INFO: `/v3/projects/555888f917234bd2b439d1465833bced` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:35.834886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] RBAC: Authorizing `identity:delete_project(project_id=555888f917234bd2b439d1465833bced)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:35.836856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:35.881886 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555888f917234bd2b439d1465833bced', 'request_id': 'req-6694d6e8-328c-46a3-978a-f03137d1551a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.888463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555888f917234bd2b439d1465833bced', 'request_id': 'req-6694d6e8-328c-46a3-978a-f03137d1551a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.896184 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555888f917234bd2b439d1465833bced', 'request_id': 'req-6694d6e8-328c-46a3-978a-f03137d1551a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.907191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] The token cache is being invalidate because project 555888f917234bd2b439d1465833bced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:35.907518 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.908133 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-6694d6e8-328c-46a3-978a-f03137d1551a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:35.909624 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1261/2499] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:35 2022] DELETE /identity/v3/projects/555888f917234bd2b439d1465833bced => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:35.914501 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:35.914782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:35.915052 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:35.934410 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:35.935627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:35.993828 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1239/2500] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:36.001513 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.001823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.002096 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.022093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:36.023285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:36.031890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1262/2501] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:36.035839 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.045095 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff13b-80cb-420c-b27e-e9345b76f4ea None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.049530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.050116 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.050394 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.050659 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.051294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:36.051618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.053246 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.065112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1240/2502] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:36.069099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.078656 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead04122-ed9c-468c-81ff-77c1f657a489 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.083287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.083903 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.084183 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.084457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.085093 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.086970 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.112677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1263/2503] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:36 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:36.116655 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.126804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f1067-5fd2-41bc-9307-5d020764b068 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.181635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.182228 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.182509 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.183321 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.183968 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.185880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.206692 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1241/2504] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:36 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:36.210856 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.221230 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657d94-69e3-428a-8e99-ff0b96f7c5e7 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.225829 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.226454 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.226728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.226998 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.227685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.229273 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.238930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1264/2505] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:36.242847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.253345 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688d3e-9eb5-4585-bad9-c5e1630c86c2 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.258023 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96956-f20e-4024-9bea-6f4867d3e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.258611 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96956-f20e-4024-9bea-6f4867d3e46b admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.258889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96956-f20e-4024-9bea-6f4867d3e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.259162 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96956-f20e-4024-9bea-6f4867d3e46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.259835 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96956-f20e-4024-9bea-6f4867d3e46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.262142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda96956-f20e-4024-9bea-6f4867d3e46b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.263280 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:36.274657 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1242/2506] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:36.278155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.288061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa400210-56f7-46bb-b49b-9263ee458f7c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.292729 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.293364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.293642 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.293911 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] PATH_INFO: `/v3/projects/0a3ab520b03c49dd9de0c8cc56032106/users/73a2133cea434bc58af24ca55f89383b/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.308547 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3ab520b03c49dd9de0c8cc56032106, user_id=73a2133cea434bc58af24ca55f89383b, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.311113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.325447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1265/2507] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:36 2022] PUT /identity/v3/projects/0a3ab520b03c49dd9de0c8cc56032106/users/73a2133cea434bc58af24ca55f89383b/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:36.336798 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476898-e165-4003-82f0-a5260dc143be None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.337186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476898-e165-4003-82f0-a5260dc143be None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.337556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476898-e165-4003-82f0-a5260dc143be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.365691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-f9476898-e165-4003-82f0-a5260dc143be None None] MFA Rules not processed for user `73a2133cea434bc58af24ca55f89383b`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:36.366900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f9476898-e165-4003-82f0-a5260dc143be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:36.430257 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1243/2508] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:36.444610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.446403 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:36.518026 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf2541-8aa8-4ce4-ac16-48d328f9f5a5 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.523865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5cb39-ae0b-4495-97ab-9b084107da9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.524470 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5cb39-ae0b-4495-97ab-9b084107da9e service nova] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.524747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5cb39-ae0b-4495-97ab-9b084107da9e service nova] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.525025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5cb39-ae0b-4495-97ab-9b084107da9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.532607 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5cb39-ae0b-4495-97ab-9b084107da9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.534191 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5cb39-ae0b-4495-97ab-9b084107da9e service nova] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.543345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1266/2509] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:36.760269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476898-e165-4003-82f0-a5260dc143be None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:36.822728 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476898-e165-4003-82f0-a5260dc143be None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:36.827275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:36.827868 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.828149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.828421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] PATH_INFO: `/v3/users/73a2133cea434bc58af24ca55f89383b` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.829538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a2133cea434bc58af24ca55f89383b)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:36.831506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:36.876214 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a2133cea434bc58af24ca55f89383b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:36.882989 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a2133cea434bc58af24ca55f89383b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:36.894755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a2133cea434bc58af24ca55f89383b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:36.895464 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a2133cea434bc58af24ca55f89383b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:36.903310 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a2133cea434bc58af24ca55f89383b'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:36.909165 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1244/2510] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:36 2022] DELETE /identity/v3/users/73a2133cea434bc58af24ca55f89383b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:36.913723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:36.914027 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:36.914303 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:36.928223 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:36.935369 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:36.937155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:36.993966 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1267/2511] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:37.003772 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.005243 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:37.011878 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:37.064336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f783f-6be7-4400-b0ae-323014d1a42a admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.067975 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959423-6ceb-43c6-9bbb-3c24edf50ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.068568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959423-6ceb-43c6-9bbb-3c24edf50ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.068845 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959423-6ceb-43c6-9bbb-3c24edf50ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.069112 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959423-6ceb-43c6-9bbb-3c24edf50ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.077918 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d959423-6ceb-43c6-9bbb-3c24edf50ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.079277 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d959423-6ceb-43c6-9bbb-3c24edf50ee4 service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.088428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1245/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:37.349641 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.351180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:37.363474 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e6cb-17b2-43f5-abfe-a6858eeb4861 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.368313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.369045 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.369392 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.369766 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] PATH_INFO: `/v3/projects/0a3ab520b03c49dd9de0c8cc56032106` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.371035 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3ab520b03c49dd9de0c8cc56032106)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.373108 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.419838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3ab520b03c49dd9de0c8cc56032106', 'request_id': 'req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:37.425792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3ab520b03c49dd9de0c8cc56032106', 'request_id': 'req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:37.433155 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3ab520b03c49dd9de0c8cc56032106', 'request_id': 'req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:37.443190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] The token cache is being invalidate because project 0a3ab520b03c49dd9de0c8cc56032106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:37.443507 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:37.444131 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-0a7c38f5-61b5-4ef2-89c2-4d88862e7a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:37.445600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1268/2513] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:37 2022] DELETE /identity/v3/projects/0a3ab520b03c49dd9de0c8cc56032106 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:37.450972 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.451385 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.451585 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.471792 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:37.472998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:37.530762 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1246/2514] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:37.538283 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.538566 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.538865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.558816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:37.560075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:37.567840 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1269/2515] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:37.571999 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.582360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f0f6-95bc-4a02-a76f-d8a44f025e6e None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.586960 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.587586 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.587869 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.588143 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.588788 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:37.589118 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.590713 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.602050 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1247/2516] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:37.606107 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.615163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5f4d6-cb82-4fbd-9cff-04415f8f1f22 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.619993 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.621200 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.621480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.621752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.622385 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.624314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.651707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1270/2517] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:37 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:37.655694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.665914 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf993-4776-4652-a346-f93c13e8c024 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.721022 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.721641 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.721925 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.722197 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.722846 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.724815 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.746997 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1248/2518] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:37 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:37.751128 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.762048 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356222-49aa-4467-aa9e-bd5b38c89b44 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.766598 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.767192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.767502 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.767777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.768421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.770008 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.780077 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1271/2519] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:37.783877 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.793654 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6b3c8-9145-4994-9fcb-86d22334b24b admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.798417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73f28-a6f5-474b-a329-52c3aa6c6c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.799006 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73f28-a6f5-474b-a329-52c3aa6c6c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.799286 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73f28-a6f5-474b-a329-52c3aa6c6c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.799605 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73f28-a6f5-474b-a329-52c3aa6c6c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.800245 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73f28-a6f5-474b-a329-52c3aa6c6c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.801823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73f28-a6f5-474b-a329-52c3aa6c6c71 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.812880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1249/2520] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:37.816838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:37.828618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d989-2a76-4158-a92e-e55359565230 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:37.834546 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:37.835208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.835520 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.835799 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] PATH_INFO: `/v3/projects/ee684591c5134c148ad7764ea58f0576/users/33423af4603447f99bd013eec8328935/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.850528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee684591c5134c148ad7764ea58f0576, user_id=33423af4603447f99bd013eec8328935, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:37.853511 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:37.865758 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1272/2521] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:37 2022] PUT /identity/v3/projects/ee684591c5134c148ad7764ea58f0576/users/33423af4603447f99bd013eec8328935/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:37.876552 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:37.876862 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:37.877142 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:37.902319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:37.905799 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] MFA Rules not processed for user `33423af4603447f99bd013eec8328935`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:37.907667 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:37.969912 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1250/2522] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:37.974484 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.004929 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:38.036708 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1a6c-f12b-47d0-9143-2ac315e291f0 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.041281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.041867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.042673 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.042942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.043583 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.045479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.071013 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1273/2523] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:37 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:38.075122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.085534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6a7ff-9672-4155-83be-1c08bfb2c8d2 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.139573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.140098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.140376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.140645 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.141258 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.143151 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.163675 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1251/2524] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:38 2022] POST /identity/v3/users => generated 308 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:38.168208 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.178606 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c66a7-cecc-4ff3-b48f-8a196fa29c5d admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.183823 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.184409 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.184681 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.184949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.185577 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.187149 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.197318 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1274/2525] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:38.201313 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.210955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfc16-9499-45c8-96f7-b420a89059a1 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.215490 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.216128 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.216404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.216674 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] PATH_INFO: `/v3/projects/4dedf3ac86344d308a2fbddee7328f90/users/18a8f3f0031e4773ba84b47fa999dff7/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.231453 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dedf3ac86344d308a2fbddee7328f90, user_id=18a8f3f0031e4773ba84b47fa999dff7, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.234081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.247847 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1252/2526] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:38 2022] PUT /identity/v3/projects/4dedf3ac86344d308a2fbddee7328f90/users/18a8f3f0031e4773ba84b47fa999dff7/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:38.251685 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.261995 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44335c31-0fe7-40ef-852d-2bc9f350945f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.316764 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98936d-dc00-4d9c-81ea-e1fbe3370927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.317361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98936d-dc00-4d9c-81ea-e1fbe3370927 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.317643 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98936d-dc00-4d9c-81ea-e1fbe3370927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.317901 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98936d-dc00-4d9c-81ea-e1fbe3370927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.318531 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98936d-dc00-4d9c-81ea-e1fbe3370927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.320135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98936d-dc00-4d9c-81ea-e1fbe3370927 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.329811 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1275/2527] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:38.333883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.344602 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdac3f-e841-4a5d-9b3a-2ecbbc615199 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.349240 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.349881 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.350159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.350428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] PATH_INFO: `/v3/projects/4dedf3ac86344d308a2fbddee7328f90/users/18a8f3f0031e4773ba84b47fa999dff7/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.352415 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dedf3ac86344d308a2fbddee7328f90, user_id=18a8f3f0031e4773ba84b47fa999dff7, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.355719 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.365803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1253/2528] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:38 2022] PUT /identity/v3/projects/4dedf3ac86344d308a2fbddee7328f90/users/18a8f3f0031e4773ba84b47fa999dff7/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:38.377106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.377389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.377658 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.405059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] MFA Rules not processed for user `18a8f3f0031e4773ba84b47fa999dff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:38.406192 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:38.471885 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1276/2529] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:38.483187 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.484958 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:38.543414 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2bb2-5e76-4f9a-99a5-74f9f34f0c6d admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.547127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a86b-735b-4b53-be7f-89932a304adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.547755 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a86b-735b-4b53-be7f-89932a304adc service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.548035 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a86b-735b-4b53-be7f-89932a304adc service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.548305 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a86b-735b-4b53-be7f-89932a304adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.557362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22a86b-735b-4b53-be7f-89932a304adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.558856 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22a86b-735b-4b53-be7f-89932a304adc service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.562723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:38.569992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1254/2530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:38.704060 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.729752 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:38.766719 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75138f2-1ac7-4ef0-b163-d362678cbce3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:38.771246 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:38.771910 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.772190 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.772463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] PATH_INFO: `/v3/users/33423af4603447f99bd013eec8328935` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.773571 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33423af4603447f99bd013eec8328935)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:38.775776 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:38.820015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33423af4603447f99bd013eec8328935'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:38.820665 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33423af4603447f99bd013eec8328935'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:38.833044 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33423af4603447f99bd013eec8328935'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:38.840688 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33423af4603447f99bd013eec8328935'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:38.841305 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33423af4603447f99bd013eec8328935'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:38.853381 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1277/2531] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:38 2022] DELETE /identity/v3/users/33423af4603447f99bd013eec8328935 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:38.857832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:38.858149 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:38.858404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:38.877461 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:38.878706 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:38.936684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1255/2532] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:38.946201 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:38.947611 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:39.005459 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae407e-55e2-463a-90c5-02952204add9 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:39.009180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:39.009788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:39.010078 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:39.010351 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:39.019979 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:39.021425 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:39.031648 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1278/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:39.290381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:39.291890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:39.304746 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886951-983d-4cb4-acf0-b8cd26478b49 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:39.309998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:39.310661 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:39.310935 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:39.311205 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] PATH_INFO: `/v3/projects/ee684591c5134c148ad7764ea58f0576` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:39.312495 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee684591c5134c148ad7764ea58f0576)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:39.314425 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:39.367275 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee684591c5134c148ad7764ea58f0576', 'request_id': 'req-66562b85-8661-4915-bcad-29446768bde6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.374538 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee684591c5134c148ad7764ea58f0576', 'request_id': 'req-66562b85-8661-4915-bcad-29446768bde6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.382902 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee684591c5134c148ad7764ea58f0576', 'request_id': 'req-66562b85-8661-4915-bcad-29446768bde6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.395033 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] The token cache is being invalidate because project ee684591c5134c148ad7764ea58f0576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:39.395311 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.396166 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.397690 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1256/2534] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:39 2022] DELETE /identity/v3/projects/ee684591c5134c148ad7764ea58f0576 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:39.402181 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:39.412463 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf6eb-f821-48bd-8a14-e8505f7211ec service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:39.456114 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:39.474144 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:39.474723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:39.475012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:39.475284 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] PATH_INFO: `/v3/users/18a8f3f0031e4773ba84b47fa999dff7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:39.476424 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a8f3f0031e4773ba84b47fa999dff7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:39.478344 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:39.522225 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a8f3f0031e4773ba84b47fa999dff7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.522854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a8f3f0031e4773ba84b47fa999dff7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.535239 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a8f3f0031e4773ba84b47fa999dff7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.542265 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a8f3f0031e4773ba84b47fa999dff7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.542937 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a95c25c1-db72-4105-b41a-f3b4bbd03f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a8f3f0031e4773ba84b47fa999dff7'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.554832 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1279/2535] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:39 2022] DELETE /identity/v3/users/18a8f3f0031e4773ba84b47fa999dff7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:39.816500 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:39.818014 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:39.832992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66562b85-8661-4915-bcad-29446768bde6 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:39.891535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:39.892163 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:39.892445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:39.892716 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] PATH_INFO: `/v3/projects/4dedf3ac86344d308a2fbddee7328f90` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:39.893849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dedf3ac86344d308a2fbddee7328f90)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:39.895790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:39.919547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:39.942535 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dedf3ac86344d308a2fbddee7328f90', 'request_id': 'req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.949110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dedf3ac86344d308a2fbddee7328f90', 'request_id': 'req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.956503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dedf3ac86344d308a2fbddee7328f90', 'request_id': 'req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.966921 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] The token cache is being invalidate because project 4dedf3ac86344d308a2fbddee7328f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:39.967207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.967880 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-a65359a5-f2bf-4a94-a6d6-813e8c63bc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:39.969347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1257/2536] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:39 2022] DELETE /identity/v3/projects/4dedf3ac86344d308a2fbddee7328f90 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:39.974163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:39.974448 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:39.974721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:39.998189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:39.999361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:40.055638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1280/2537] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:40.063751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.064045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.064342 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.084669 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:40.085904 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:40.093821 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1258/2538] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:40.098004 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.107579 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634353-0966-48f9-aa3d-cb56c412c447 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.112038 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.112621 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.112894 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.113159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.113791 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:40.114087 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.115709 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.127319 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1281/2539] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:40.131395 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.141092 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48ae2-360e-44d0-8219-cd2701850340 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.145748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.146336 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.146618 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.146893 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.147564 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.149720 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.176751 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1259/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:20:40.180955 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.191300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bd77d-22d5-4f92-bfd5-5abfc97cb387 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.236808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:40.248187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.248833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.249062 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.249332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.249945 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.251897 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.272166 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1282/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:40.276458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.286506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8672b5-f5c9-4731-a3b9-f28b3a041b60 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.290995 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.291610 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.291889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.292666 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.293333 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.294906 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.304573 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1260/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:40.309097 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.319276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ac3fe-eac3-4883-a9cb-a7b5c096cb3f admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.324227 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45fa8b-498f-4041-8670-210d9fa6478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.324815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45fa8b-498f-4041-8670-210d9fa6478e admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.325095 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45fa8b-498f-4041-8670-210d9fa6478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.325368 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45fa8b-498f-4041-8670-210d9fa6478e admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.326003 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45fa8b-498f-4041-8670-210d9fa6478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.327610 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45fa8b-498f-4041-8670-210d9fa6478e admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.338202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1283/2543] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:40.342180 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.351916 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e4d6-431f-4f5a-9258-dae824dea052 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.356951 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.357581 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.357857 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.358127 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] PATH_INFO: `/v3/projects/e5df47d5dc13434c80d8e4df69f07993/users/eae469a06914403c839c0b67b19d9760/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.373892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5df47d5dc13434c80d8e4df69f07993, user_id=eae469a06914403c839c0b67b19d9760, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.376547 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.388612 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1261/2544] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:40 2022] PUT /identity/v3/projects/e5df47d5dc13434c80d8e4df69f07993/users/eae469a06914403c839c0b67b19d9760/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:40.398824 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.399382 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.399691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.427135 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] MFA Rules not processed for user `eae469a06914403c839c0b67b19d9760`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:40.428384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:40.490660 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1284/2545] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:40.495300 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.556376 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8872a9-b744-44b8-adbc-78461a739124 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.561235 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.561827 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.562102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.562438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.563068 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.564990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.590983 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1262/2546] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:40.595138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.606215 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83345682-31d5-4526-a8a4-e59bc2b8576b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.660932 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.661535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.661816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.662090 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] PATH_INFO: `/v3/users` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.662741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.664662 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.685295 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1285/2547] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:20:40.689367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.699920 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed161761-b11a-4299-ac14-73f641575311 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.705225 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.705820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.706096 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.706363 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.707129 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.709237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.721530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1263/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:40.725773 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.736747 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059f9b-da7d-413b-b0d1-ba39c5b6261c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.741581 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.742233 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.742542 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.742818 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] PATH_INFO: `/v3/projects/51235cf826b24ca28d816fec85c66836/users/4fdf29df76b442ee947d42b5b9034f10/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.757147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51235cf826b24ca28d816fec85c66836, user_id=4fdf29df76b442ee947d42b5b9034f10, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.759852 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.772169 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1286/2549] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:40 2022] PUT /identity/v3/projects/51235cf826b24ca28d816fec85c66836/users/4fdf29df76b442ee947d42b5b9034f10/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:20:40.776343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.786683 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86091c8-4958-4b2a-8cc3-3ef1997c7121 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.805045 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:40.844594 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6daea-6906-44b6-ba23-badd51018a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.845269 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6daea-6906-44b6-ba23-badd51018a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.845468 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6daea-6906-44b6-ba23-badd51018a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.845738 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6daea-6906-44b6-ba23-badd51018a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.846366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6daea-6906-44b6-ba23-badd51018a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.848001 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6daea-6906-44b6-ba23-badd51018a2c admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.858048 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1264/2550] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:40.862236 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:40.872528 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc08a-99af-4c87-932a-2d5067bcf714 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:40.877480 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:40.878123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.878397 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.878664 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] PATH_INFO: `/v3/projects/51235cf826b24ca28d816fec85c66836/users/4fdf29df76b442ee947d42b5b9034f10/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.880693 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] RBAC: Authorizing `identity:create_grant(project_id=51235cf826b24ca28d816fec85c66836, user_id=4fdf29df76b442ee947d42b5b9034f10, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:40.883360 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:40.893367 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1287/2551] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:40 2022] PUT /identity/v3/projects/51235cf826b24ca28d816fec85c66836/users/4fdf29df76b442ee947d42b5b9034f10/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:40.905194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:40.905487 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:40.905765 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:40.935292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] MFA Rules not processed for user `4fdf29df76b442ee947d42b5b9034f10`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:40.936530 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:41.016433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1265/2552] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:41.027991 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:41.029726 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:41.044126 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:41.089332 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf41b-6386-45ff-81e8-db024ab733be admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:41.093158 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9cca9-4b0d-4347-a96f-be8ebcf5b2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:41.093792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cca9-4b0d-4347-a96f-be8ebcf5b2fd service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:41.094067 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cca9-4b0d-4347-a96f-be8ebcf5b2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:41.094335 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cca9-4b0d-4347-a96f-be8ebcf5b2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:41.103704 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9cca9-4b0d-4347-a96f-be8ebcf5b2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:41.105582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9cca9-4b0d-4347-a96f-be8ebcf5b2fd service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:41.115185 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1288/2553] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:41.513457 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:41.576700 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781b716-7aa3-4d14-bd39-f62b132dca1a None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:41.581267 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:41.581898 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:41.582175 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:41.582447 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] PATH_INFO: `/v3/users/eae469a06914403c839c0b67b19d9760` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:41.583600 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae469a06914403c839c0b67b19d9760)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:41.585526 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:41.629546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:41.631643 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae469a06914403c839c0b67b19d9760'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:41.639782 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae469a06914403c839c0b67b19d9760'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:41.651575 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae469a06914403c839c0b67b19d9760'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:41.652786 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae469a06914403c839c0b67b19d9760'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:41.660186 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae469a06914403c839c0b67b19d9760'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:41.666317 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1266/2554] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:41 2022] DELETE /identity/v3/users/eae469a06914403c839c0b67b19d9760 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:41.671308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:41.671833 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:41.671942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:41.690437 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:41.691676 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:41.749281 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1289/2555] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:41.758978 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:41.760401 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:41.816249 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd3c68-d743-4bce-bec7-85367f74b08e admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:41.819940 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:41.820543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:41.820823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:41.821094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:41.830427 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:41.831884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:41.841606 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1267/2556] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:42.111147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:42.112701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:42.126099 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7835-b132-496c-930a-d43463478da2 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:42.131790 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:42.132849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.133258 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.133649 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] PATH_INFO: `/v3/projects/e5df47d5dc13434c80d8e4df69f07993` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.135088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5df47d5dc13434c80d8e4df69f07993)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:42.137634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:42.183964 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5df47d5dc13434c80d8e4df69f07993', 'request_id': 'req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.189922 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5df47d5dc13434c80d8e4df69f07993', 'request_id': 'req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.197088 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5df47d5dc13434c80d8e4df69f07993', 'request_id': 'req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.207808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] The token cache is being invalidate because project e5df47d5dc13434c80d8e4df69f07993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:42.208094 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.208717 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.210186 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1290/2557] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:42 2022] DELETE /identity/v3/projects/e5df47d5dc13434c80d8e4df69f07993 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:42.214150 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:42.223785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53680ac2-0a24-47ca-90e7-2107ea73b88b service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:42.281875 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:42.282503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.282785 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.283058 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] PATH_INFO: `/v3/users/4fdf29df76b442ee947d42b5b9034f10` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.284202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdf29df76b442ee947d42b5b9034f10)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:42.286122 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:42.331020 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdf29df76b442ee947d42b5b9034f10'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.337635 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdf29df76b442ee947d42b5b9034f10'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.345227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:42.350231 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdf29df76b442ee947d42b5b9034f10'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.350987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdf29df76b442ee947d42b5b9034f10'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.358596 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-4413ea29-87ca-411f-8bbd-b07e92a45e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdf29df76b442ee947d42b5b9034f10'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.364723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1268/2558] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:42 2022] DELETE /identity/v3/users/4fdf29df76b442ee947d42b5b9034f10 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:42.635489 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:42.636973 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:42.650452 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a691c3-1330-4f76-8fd1-b1986f6acbbe admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:42.685098 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:42.709313 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:42.709878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.710160 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.710434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] PATH_INFO: `/v3/projects/51235cf826b24ca28d816fec85c66836` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.711585 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] RBAC: Authorizing `identity:delete_project(project_id=51235cf826b24ca28d816fec85c66836)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:42.713516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:42.760472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51235cf826b24ca28d816fec85c66836', 'request_id': 'req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.766431 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51235cf826b24ca28d816fec85c66836', 'request_id': 'req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.773739 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51235cf826b24ca28d816fec85c66836', 'request_id': 'req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.785209 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] The token cache is being invalidate because project 51235cf826b24ca28d816fec85c66836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:42.785496 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.786120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-4d9b8b10-2b9e-4db5-8d87-9a40ae2b03df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:42.787629 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1291/2559] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:42 2022] DELETE /identity/v3/projects/51235cf826b24ca28d816fec85c66836 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:42.793060 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.793423 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.793722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.812733 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:42.813931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:42.874503 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1269/2560] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:42.882138 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.882427 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.882703 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.902864 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:42.904116 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:42.912023 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1292/2561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:42.916042 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:42.926242 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520a9a3-757b-4345-8e7b-263bfb0e37b7 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:42.931160 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:42.931791 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.932074 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.932347 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.932990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:42.933292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:42.934884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:42.946174 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1270/2562] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:42.950451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:42.959713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ac0b1-91d1-4fc3-ad61-869a12c567b3 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:42.964750 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:42.965343 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:42.965627 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:42.965896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:42.966526 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:42.968455 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:42.999245 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1293/2563] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:42 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:42.999747 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.009760 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427d75d-bf89-42b4-a870-bce7c25a4234 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.064832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.065514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.066076 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.066366 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.066990 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.068946 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.089184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1271/2564] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:42 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:20:43.093867 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.103896 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2117d-1cfa-4e49-b3aa-a6cfb5942e2c admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.109256 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.109854 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.110132 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.110432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.111100 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.112748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.122372 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1294/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:20:43.126085 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.135884 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284efc1-2e1e-4e94-9510-333652f0a0f4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.140418 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2182dce-bcdb-4de8-b041-12cc8735a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.140994 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182dce-bcdb-4de8-b041-12cc8735a5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.141273 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182dce-bcdb-4de8-b041-12cc8735a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.141619 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182dce-bcdb-4de8-b041-12cc8735a5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.142251 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2182dce-bcdb-4de8-b041-12cc8735a5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.143891 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2182dce-bcdb-4de8-b041-12cc8735a5e7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.155255 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1272/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:43.160076 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.170615 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b5bb-bd4d-4102-bf6c-c05a6ff31c64 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.175153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.175836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.176153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.176428 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] PATH_INFO: `/v3/projects/ee5885c7892043d78d3cbf8129eb5a56/users/0aa296944945428792fd203f083e11e5/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.190503 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5885c7892043d78d3cbf8129eb5a56, user_id=0aa296944945428792fd203f083e11e5, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.193159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.205808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1295/2567] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:43 2022] PUT /identity/v3/projects/ee5885c7892043d78d3cbf8129eb5a56/users/0aa296944945428792fd203f083e11e5/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 13:20:43.216517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.216979 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.217094 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.244110 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] MFA Rules not processed for user `0aa296944945428792fd203f083e11e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:43.245295 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:43.285514 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:43.310591 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1273/2568] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:43.315025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.375515 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884afe4-f06a-4d68-9bdc-ea99acc0ac99 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.380180 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.380777 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.381055 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.381328 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.381951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.383877 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.393461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:43.415025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1296/2569] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:43 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:43.419417 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.429826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b74c4-7503-4b08-85d0-0e70ac10f465 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.484029 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.484551 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.484825 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.485093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.485704 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.487620 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.507889 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1274/2570] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:43 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:43.512364 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.522692 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa319681-94a7-4f74-a0c3-bdc7bdc1e368 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.528304 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.528891 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.529165 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.529434 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.530064 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.531678 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.541260 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1297/2571] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:43.545156 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.554778 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ca60-9f0d-456d-90e9-586f71464e45 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.560299 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.560928 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.561202 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.561469 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] PATH_INFO: `/v3/projects/820dee200cd44d1f82d0247eb58a6195/users/dc1868ab5d924189a284c0ee3beb5f51/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.576178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820dee200cd44d1f82d0247eb58a6195, user_id=dc1868ab5d924189a284c0ee3beb5f51, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.578820 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.591191 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1275/2572] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:43 2022] PUT /identity/v3/projects/820dee200cd44d1f82d0247eb58a6195/users/dc1868ab5d924189a284c0ee3beb5f51/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:43.595010 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.604865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b836cd-9e2e-4040-b84b-c28f36b7f3c8 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.659559 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cb911-9ee9-439e-be53-d7c9d66f4438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.660153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cb911-9ee9-439e-be53-d7c9d66f4438 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.660430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cb911-9ee9-439e-be53-d7c9d66f4438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.660699 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cb911-9ee9-439e-be53-d7c9d66f4438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.661327 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cb911-9ee9-439e-be53-d7c9d66f4438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.662912 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cb911-9ee9-439e-be53-d7c9d66f4438 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.672482 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1298/2573] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 13:20:43.676438 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.687051 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a743a9-82ae-4272-a459-05dd0cb56fd7 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.691865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.692599 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.692883 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.693158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] PATH_INFO: `/v3/projects/820dee200cd44d1f82d0247eb58a6195/users/dc1868ab5d924189a284c0ee3beb5f51/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.695126 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820dee200cd44d1f82d0247eb58a6195, user_id=dc1868ab5d924189a284c0ee3beb5f51, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.697823 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.708433 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1276/2574] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:43 2022] PUT /identity/v3/projects/820dee200cd44d1f82d0247eb58a6195/users/dc1868ab5d924189a284c0ee3beb5f51/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:43.772251 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.772788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.772788 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.800092 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] MFA Rules not processed for user `dc1868ab5d924189a284c0ee3beb5f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:43.801285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:43.867356 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1299/2575] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:20:43.878932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:43.880658 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:43.939343 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e7d3-314d-4f27-94bf-cb7c9e2c7c16 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:43.942992 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:43.943624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:43.943932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:43.944199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:43.953021 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:43.954444 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:43.963872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1277/2576] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:44.008527 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:44.009930 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:44.022510 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cb1e5-ce34-4471-aa98-3c2e3bf9191b None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:44.026366 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784642c-0585-450b-98a5-88e59fb300e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:44.027015 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784642c-0585-450b-98a5-88e59fb300e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:44.027294 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784642c-0585-450b-98a5-88e59fb300e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:44.027600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784642c-0585-450b-98a5-88e59fb300e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:44.083804 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784642c-0585-450b-98a5-88e59fb300e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:44.085226 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784642c-0585-450b-98a5-88e59fb300e3 service cinder] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:44.088728 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:44.095655 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1300/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:47.714522 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:47.752807 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:47.777106 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c1431-a4c8-4c37-a6e6-88298eb0d622 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:47.781890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:47.782517 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:47.782829 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:47.783103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] PATH_INFO: `/v3/users/0aa296944945428792fd203f083e11e5` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:47.784256 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa296944945428792fd203f083e11e5)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:47.786176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:47.830754 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa296944945428792fd203f083e11e5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:47.838364 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa296944945428792fd203f083e11e5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:47.849844 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa296944945428792fd203f083e11e5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:47.850534 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa296944945428792fd203f083e11e5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:47.857515 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa296944945428792fd203f083e11e5'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:47.863492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1278/2578] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:47 2022] DELETE /identity/v3/users/0aa296944945428792fd203f083e11e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:47.867962 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:47.868447 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:47.868868 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:47.887997 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:47.889187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:47.946813 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1301/2579] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:47.956371 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:47.957781 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:48.014362 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f827-46f8-45bf-8283-b974606eb528 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:48.017931 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:48.018532 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:48.018809 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:48.019079 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:48.028673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:48.030100 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:48.039303 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1279/2580] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:48.300906 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:48.302383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:48.314308 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f87bb7-d703-4d4a-822f-abd245e10af7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:48.318860 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:48.319519 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:48.319798 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:48.320075 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] PATH_INFO: `/v3/projects/ee5885c7892043d78d3cbf8129eb5a56` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:48.321187 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5885c7892043d78d3cbf8129eb5a56)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:48.323207 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:48.368159 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5885c7892043d78d3cbf8129eb5a56', 'request_id': 'req-b3e54269-7915-43f1-9eac-b566f1129bf6'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.374819 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5885c7892043d78d3cbf8129eb5a56', 'request_id': 'req-b3e54269-7915-43f1-9eac-b566f1129bf6'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.382514 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5885c7892043d78d3cbf8129eb5a56', 'request_id': 'req-b3e54269-7915-43f1-9eac-b566f1129bf6'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.393012 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] The token cache is being invalidate because project ee5885c7892043d78d3cbf8129eb5a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:48.393300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.393920 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.395380 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1302/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:48 2022] DELETE /identity/v3/projects/ee5885c7892043d78d3cbf8129eb5a56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:48.399340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:48.409555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ed97-9c18-43b0-b6f4-f390b51206cf service neutron] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:48.458158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:48.464776 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:48.465440 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:48.466458 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:48.467117 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] PATH_INFO: `/v3/users/dc1868ab5d924189a284c0ee3beb5f51` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:48.468569 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1868ab5d924189a284c0ee3beb5f51)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:48.470790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:48.515370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1868ab5d924189a284c0ee3beb5f51'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.522093 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1868ab5d924189a284c0ee3beb5f51'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.534279 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1868ab5d924189a284c0ee3beb5f51'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.534930 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1868ab5d924189a284c0ee3beb5f51'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.541498 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-1911907d-6581-4102-b65e-b1ca00a73c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1868ab5d924189a284c0ee3beb5f51'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.547508 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1280/2582] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:48 2022] DELETE /identity/v3/users/dc1868ab5d924189a284c0ee3beb5f51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:48.808066 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:48.810120 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:48.823220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e54269-7915-43f1-9eac-b566f1129bf6 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:48.879339 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:48.880408 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:48.880408 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:48.880613 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] PATH_INFO: `/v3/projects/820dee200cd44d1f82d0247eb58a6195` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:48.881789 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820dee200cd44d1f82d0247eb58a6195)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:48.883714 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:48.907841 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:48.929925 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820dee200cd44d1f82d0247eb58a6195', 'request_id': 'req-f9d8a507-7073-484e-98ab-a692407f10a8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.936458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820dee200cd44d1f82d0247eb58a6195', 'request_id': 'req-f9d8a507-7073-484e-98ab-a692407f10a8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.943388 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820dee200cd44d1f82d0247eb58a6195', 'request_id': 'req-f9d8a507-7073-484e-98ab-a692407f10a8'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.954163 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] The token cache is being invalidate because project 820dee200cd44d1f82d0247eb58a6195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:48.954445 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.955072 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-f9d8a507-7073-484e-98ab-a692407f10a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:48.956563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1303/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:48 2022] DELETE /identity/v3/projects/820dee200cd44d1f82d0247eb58a6195 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:48.961367 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:48.961832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:48.961937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:48.981351 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:48.982544 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:49.041119 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1281/2584] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 13:20:49.048951 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.049234 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.049504 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.069516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:49.070653 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:49.078748 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1304/2585] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:49.083421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.093404 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd134f-9d15-4cf5-a046-f55514990f81 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.097937 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.098524 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.098804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.099072 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.099739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:49.100038 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.101790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.113861 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1282/2586] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 13:20:49.118123 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.127147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57c1b-7a7b-4803-b46d-35fb04bb0d1a None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.131810 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.132399 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.132677 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.132943 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.133563 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.135458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.165089 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1305/2587] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 13:20:49.169378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.179773 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8b7b7-56f3-4b8d-a534-e27216df0f28 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.236232 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.236826 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.237103 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.237372 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.237998 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.239970 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.249900 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:49.264865 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1283/2588] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:49.266147 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.276600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360cec1-7cc4-485b-acc1-a5729a577b55 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.281989 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.282588 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.282869 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.283143 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.283849 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.285451 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.295362 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1306/2589] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:49.299512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.309196 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427e86e-dc58-492f-a89d-d76bbadcd131 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.313715 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e0279-27ac-4b0a-9635-4a9c1a414f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.314292 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e0279-27ac-4b0a-9635-4a9c1a414f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.314566 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e0279-27ac-4b0a-9635-4a9c1a414f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.314833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e0279-27ac-4b0a-9635-4a9c1a414f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.315492 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e0279-27ac-4b0a-9635-4a9c1a414f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.317059 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e0279-27ac-4b0a-9635-4a9c1a414f3f admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.327897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1284/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:49.331882 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.342361 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba0719-f260-4729-981f-e9bf52871326 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.346963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.347634 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] REQUEST_METHOD: `PUT` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.347915 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.348189 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] PATH_INFO: `/v3/projects/4f2506cc3c274bfd932c90856bd32eaa/users/04dd820b3d654df4ad619e41097b9065/roles/c4d52d7819e647bcbe57fa726e019998` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.362468 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2506cc3c274bfd932c90856bd32eaa, user_id=04dd820b3d654df4ad619e41097b9065, role_id=c4d52d7819e647bcbe57fa726e019998)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.365141 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.379129 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1307/2591] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:49 2022] PUT /identity/v3/projects/4f2506cc3c274bfd932c90856bd32eaa/users/04dd820b3d654df4ad619e41097b9065/roles/c4d52d7819e647bcbe57fa726e019998 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:49.390822 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.391107 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.391378 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.419494 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] MFA Rules not processed for user `04dd820b3d654df4ad619e41097b9065`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:49.420739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:49.482319 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1285/2592] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:49.487009 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.546647 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396d01-0b4a-4b34-a0fc-041d946ba9df admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.551220 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.551835 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.552113 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.552383 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.553007 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.554893 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.581486 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1308/2593] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:49.585623 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.596297 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142c0e-5f2d-4b93-942b-e9f3042e0c8d None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.650879 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.651506 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.651794 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.652070 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.652691 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.654604 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.675380 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1286/2594] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:49.679487 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.690056 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b147-d3af-4a49-8e23-3ad873254700 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.694741 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.695350 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.695659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.695963 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.696608 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.698212 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.709384 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1309/2595] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:49.713199 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.723218 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c1c8e-8f11-4301-905b-c2b6207d21f4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.727832 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.728858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.728858 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.729037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] PATH_INFO: `/v3/projects/d7620bb2c9674e3a937a841e916ab0c1/users/5e8c8c47ea864377aa1ab51526c525d9/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.743897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7620bb2c9674e3a937a841e916ab0c1, user_id=5e8c8c47ea864377aa1ab51526c525d9, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.746531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.759742 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1287/2596] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:49 2022] PUT /identity/v3/projects/d7620bb2c9674e3a937a841e916ab0c1/users/5e8c8c47ea864377aa1ab51526c525d9/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:49.764287 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.774365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583d1c1-55cb-4bdb-9710-a5fd7d6d4227 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.792432 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:49.831377 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033704ff-ae55-485a-a988-d09884c606d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.832061 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033704ff-ae55-485a-a988-d09884c606d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.832292 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033704ff-ae55-485a-a988-d09884c606d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.832567 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033704ff-ae55-485a-a988-d09884c606d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.833202 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033704ff-ae55-485a-a988-d09884c606d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.834792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033704ff-ae55-485a-a988-d09884c606d2 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.844288 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1310/2597] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 13:20:49.848435 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:49.858664 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fd2c-167a-4d45-8777-1af7763b92f0 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:49.863479 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:49.864130 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] REQUEST_METHOD: `PUT` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.864411 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.864684 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] PATH_INFO: `/v3/projects/d7620bb2c9674e3a937a841e916ab0c1/users/5e8c8c47ea864377aa1ab51526c525d9/roles/64eb4dbd7d6c4e6db1560d54941a31f7` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.866627 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7620bb2c9674e3a937a841e916ab0c1, user_id=5e8c8c47ea864377aa1ab51526c525d9, role_id=64eb4dbd7d6c4e6db1560d54941a31f7)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:49.869310 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:49.879919 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1288/2598] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 13:20:49 2022] PUT /identity/v3/projects/d7620bb2c9674e3a937a841e916ab0c1/users/5e8c8c47ea864377aa1ab51526c525d9/roles/64eb4dbd7d6c4e6db1560d54941a31f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:49.890740 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] REQUEST_METHOD: `POST` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:49.891214 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:49.891336 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:49.920942 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.auth.core [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] MFA Rules not processed for user `5e8c8c47ea864377aa1ab51526c525d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81579) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:49.922148 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:49.988326 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1311/2599] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:50.001169 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:50.002953 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:50.030546 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:50.061870 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e281c6-3e0d-492a-a572-e99bdaa79ced admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:50.065512 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a96fabf57bae435eaf4b6c61cbb89346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:50.066104 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:50.066381 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:50.066646 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:50.075344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:50.076783 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:50.086004 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1289/2600] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:50.387778 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:50.396701 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776aceb-1c4a-47fa-9832-5f11c74138d7 None None] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:50.401522 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8c8c47ea864377aa1ab51526c525d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7620bb2c9674e3a937a841e916ab0c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:50.402111 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:50.402389 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:50.402659 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:50.403838 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:50.404137 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:50.405721 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:50.416890 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1312/2601] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:50.421327 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:50.430227 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1666d7-ec6a-4e3c-9bad-3ec6274e40a1 service cinder] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:50.434774 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8c8c47ea864377aa1ab51526c525d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7620bb2c9674e3a937a841e916ab0c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:50.435360 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:50.435673 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:50.435941 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] PATH_INFO: `/v3/projects` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:50.436555 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:50.438430 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:50.464886 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1290/2602] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 13:20:50 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 13:20:50.469541 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:50.479285 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fbec4-7a56-4c9c-965e-b63d2ab7516c tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:50.534723 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8c8c47ea864377aa1ab51526c525d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7620bb2c9674e3a937a841e916ab0c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:50.535314 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:50.535618 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:50.535889 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] PATH_INFO: `/v3/domains` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:50.536516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81579) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 13:20:50.536816 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:50.538404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:50.549801 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1313/2603] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 13:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 13:20:50.587102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:50.597722 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c584df-f952-405e-8b6a-b40315e55ed8 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:50.602294 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8c8c47ea864377aa1ab51526c525d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7620bb2c9674e3a937a841e916ab0c1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:50.602908 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:50.603194 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:50.603497 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] PATH_INFO: `/v3/projects/c05142319ee64698b631a0db84aa9e59` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:50.604638 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c05142319ee64698b631a0db84aa9e59)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:50.607184 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:50.652353 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05142319ee64698b631a0db84aa9e59', 'request_id': 'req-bfd4997c-84bd-4078-873d-a2d9098676e6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:50.659207 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05142319ee64698b631a0db84aa9e59', 'request_id': 'req-bfd4997c-84bd-4078-873d-a2d9098676e6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:50.666355 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05142319ee64698b631a0db84aa9e59', 'request_id': 'req-bfd4997c-84bd-4078-873d-a2d9098676e6'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:50.676759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] The token cache is being invalidate because project c05142319ee64698b631a0db84aa9e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:50.677046 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:50.677689 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-bfd4997c-84bd-4078-873d-a2d9098676e6 tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:50.679139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1291/2604] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:50 2022] DELETE /identity/v3/projects/c05142319ee64698b631a0db84aa9e59 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:50.871516 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:50.873365 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:50.901919 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:50.939475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3e7a-5432-4152-bb14-68b1ffd06a1f tempest-VolumeQuotaClassesTest-738644648 tempest-VolumeQuotaClassesTest-738644648-project-admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:50.997391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:50.997638 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:50.997918 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:50.998198 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] PATH_INFO: `/v3/users/04dd820b3d654df4ad619e41097b9065` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:50.999341 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=04dd820b3d654df4ad619e41097b9065)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:51.001300 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:51.046479 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04dd820b3d654df4ad619e41097b9065'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.047139 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04dd820b3d654df4ad619e41097b9065'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.058633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04dd820b3d654df4ad619e41097b9065'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.066492 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04dd820b3d654df4ad619e41097b9065'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.067175 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04dd820b3d654df4ad619e41097b9065'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.079972 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1314/2605] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:50 2022] DELETE /identity/v3/users/04dd820b3d654df4ad619e41097b9065 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:51.084502 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] REQUEST_METHOD: `POST` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:51.084987 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:51.085098 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:51.103325 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.auth.core [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] MFA Rules not processed for user `7689dbdad16d4fd1b82041f0857674c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 13:20:51.104481 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:51.161625 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1292/2606] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 13:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 13:20:51.171544 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:51.173373 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:51.229836 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221512b-3823-4406-987b-bed3452fd4ac admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:51.233679 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:51.234276 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:51.234558 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:51.234830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:51.240612 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:51.245404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:51.248196 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:51.257996 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1315/2607] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:20:51.518237 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:51.519699 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:51.531834 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4b4bf-fe62-4e05-a55e-40b62fdc92a4 None None] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:51.536548 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:51.537179 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:51.537459 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:51.537734 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] PATH_INFO: `/v3/projects/4f2506cc3c274bfd932c90856bd32eaa` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:51.538897 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2506cc3c274bfd932c90856bd32eaa)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:51.540824 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:51.568759 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:51.591075 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2506cc3c274bfd932c90856bd32eaa', 'request_id': 'req-16dd2fd2-14b9-43f3-8194-bca739afeaec'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.596974 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2506cc3c274bfd932c90856bd32eaa', 'request_id': 'req-16dd2fd2-14b9-43f3-8194-bca739afeaec'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.604340 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2506cc3c274bfd932c90856bd32eaa', 'request_id': 'req-16dd2fd2-14b9-43f3-8194-bca739afeaec'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.615139 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] The token cache is being invalidate because project 4f2506cc3c274bfd932c90856bd32eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:51.615471 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.616089 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.617542 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1293/2608] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:51 2022] DELETE /identity/v3/projects/4f2506cc3c274bfd932c90856bd32eaa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:51.621525 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:51.631420 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebb0b-35f6-4772-b826-544a95592ed3 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:51.685609 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:51.686154 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:51.686430 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:51.686700 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] PATH_INFO: `/v3/users/5e8c8c47ea864377aa1ab51526c525d9` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:51.687830 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8c8c47ea864377aa1ab51526c525d9)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:51.689727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:51.735792 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8c8c47ea864377aa1ab51526c525d9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.736438 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8c8c47ea864377aa1ab51526c525d9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.749535 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8c8c47ea864377aa1ab51526c525d9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.756851 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8c8c47ea864377aa1ab51526c525d9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.757521 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8c8c47ea864377aa1ab51526c525d9'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:51.770457 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1316/2609] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:20:51 2022] DELETE /identity/v3/users/5e8c8c47ea864377aa1ab51526c525d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:20:52.034370 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:20:52.035830 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:20:52.050161 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd2fd2-14b9-43f3-8194-bca739afeaec admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:20:52.106204 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:20:52.107510 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:20:52.107670 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:20:52.107932 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] PATH_INFO: `/v3/projects/d7620bb2c9674e3a937a841e916ab0c1` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:20:52.109062 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7620bb2c9674e3a937a841e916ab0c1)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:20:52.110955 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:20:52.155923 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7620bb2c9674e3a937a841e916ab0c1', 'request_id': 'req-b9907659-50fa-4085-83f7-241e77316435'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:52.161872 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7620bb2c9674e3a937a841e916ab0c1', 'request_id': 'req-b9907659-50fa-4085-83f7-241e77316435'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:52.168892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7620bb2c9674e3a937a841e916ab0c1', 'request_id': 'req-b9907659-50fa-4085-83f7-241e77316435'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:52.179220 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] The token cache is being invalidate because project d7620bb2c9674e3a937a841e916ab0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:20:52.179531 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:52.180159 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:20:52.181636 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1294/2610] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:20:52 2022] DELETE /identity/v3/projects/d7620bb2c9674e3a937a841e916ab0c1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:21:01.766865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:21:02.176373 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:21:45.307808 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:45.309249 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:45.365770 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47168b2-65b2-4dea-8ffd-6bec0f03a0ab admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:45.412727 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:45.413325 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:45.413599 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:45.413865 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:45.415582 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:45.471587 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:45.473029 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:45.482391 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1317/2611] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:21:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:21:46.525723 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:46.527241 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:46.607911 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907659-50fa-4085-83f7-241e77316435 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:46.614890 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:46.615556 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:46.615833 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:46.616102 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:46.617954 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:46.632283 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:46.633803 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:46.646478 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1295/2612] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:21:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:21:47.689315 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:47.690769 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:47.701760 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdd416-65df-4cf4-8382-b52a000c1cf8 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:47.705294 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:47.705880 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:47.706153 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:47.706421 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:47.708713 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:47.721630 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:47.723085 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:47.731829 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1318/2613] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:21:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:21:48.614628 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:48.616158 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:48.630543 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab53a3f-fb95-4f51-a72a-3e5ec9e3bb1a service nova] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:48.636390 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ff7e343a5e4aff9c4a52d1aa0332bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:48.636991 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:48.637539 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:48.637813 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:48.639568 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:48.653178 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:48.654767 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:48.666109 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1296/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:21:50.375228 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:50.384030 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd884034-df28-4f07-8339-f5b870ae7673 service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:50.387884 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fd9d9e53d0f4a2ca149de05ff08d81c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:50.388472 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] REQUEST_METHOD: `GET` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:50.388753 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:50.389025 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:50.390815 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:50.442475 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=100 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:21:50.454070 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:50.455534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:50.465633 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1319/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:21:56.428446 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:56.429892 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:56.444081 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84986-4b46-4e77-b904-bcf01d36ff51 service nova] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:56.448533 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:56.449147 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:56.449428 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:56.449694 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] PATH_INFO: `/v3/users/ab02c441c43e44c3b207b2ed0976fdb1` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:56.450790 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab02c441c43e44c3b207b2ed0976fdb1)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:56.452724 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:56.499041 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab02c441c43e44c3b207b2ed0976fdb1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.506472 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab02c441c43e44c3b207b2ed0976fdb1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.518330 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab02c441c43e44c3b207b2ed0976fdb1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.518988 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab02c441c43e44c3b207b2ed0976fdb1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.526408 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab02c441c43e44c3b207b2ed0976fdb1'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.532849 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1297/2616] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:21:56 2022] DELETE /identity/v3/users/ab02c441c43e44c3b207b2ed0976fdb1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:21:56.702458 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:56.714406 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b848-4a68-4f58-b558-3501ff7dc4fe service neutron] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:56.773297 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:56.773917 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:56.774193 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:56.774461 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] PATH_INFO: `/v3/projects/cebc99b946c7417aa5282b32e3bff9d9` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:56.775600 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebc99b946c7417aa5282b32e3bff9d9)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:56.777691 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:56.822032 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebc99b946c7417aa5282b32e3bff9d9', 'request_id': 'req-80e507a9-16a0-474d-bfc6-ac5fb3a23989'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.827878 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebc99b946c7417aa5282b32e3bff9d9', 'request_id': 'req-80e507a9-16a0-474d-bfc6-ac5fb3a23989'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.835707 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebc99b946c7417aa5282b32e3bff9d9', 'request_id': 'req-80e507a9-16a0-474d-bfc6-ac5fb3a23989'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.846059 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] The token cache is being invalidate because project cebc99b946c7417aa5282b32e3bff9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:21:56.846345 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.846968 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.848465 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1320/2617] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:21:56 2022] DELETE /identity/v3/projects/cebc99b946c7417aa5282b32e3bff9d9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:21:56.852421 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:56.853804 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:56.867445 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aed11-66bd-4acb-9b1f-744992158680 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:56.907752 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:21:56.923739 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:56.924349 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:56.924626 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:56.924896 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] PATH_INFO: `/v3/users/7bb64147d3234cad8b9b3d7bf4afa810` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:56.926037 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb64147d3234cad8b9b3d7bf4afa810)` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:56.928025 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:56.971576 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb64147d3234cad8b9b3d7bf4afa810'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.979426 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb64147d3234cad8b9b3d7bf4afa810'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.991675 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb64147d3234cad8b9b3d7bf4afa810'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.992334 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb64147d3234cad8b9b3d7bf4afa810'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:56.999624 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.notifications [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb64147d3234cad8b9b3d7bf4afa810'} {{(pid=81580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:57.005944 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1298/2618] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 13:21:56 2022] DELETE /identity/v3/users/7bb64147d3234cad8b9b3d7bf4afa810 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:21:57.180534 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Authenticating user token {{(pid=81579) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:21:57.182017 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.fernet_utils [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81579) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:21:57.196106 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e507a9-16a0-474d-bfc6-ac5fb3a23989 admin admin] Validating token access rules against request {{(pid=81579) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:21:57.252322 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7689dbdad16d4fd1b82041f0857674c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5ea501d94c4d04b906442faafb4921', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81579) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:21:57.252949 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:21:57.253229 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] SCRIPT_NAME: `/identity` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:21:57.253506 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] PATH_INFO: `/v3/projects/649bd1b9ad174a7bab4fb0e617cdfb35` {{(pid=81579) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:21:57.254614 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] RBAC: Authorizing `identity:delete_project(project_id=649bd1b9ad174a7bab4fb0e617cdfb35)` {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:21:57.256539 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] RBAC: Authorization granted {{(pid=81579) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:21:57.280006 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:21:57.303561 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649bd1b9ad174a7bab4fb0e617cdfb35', 'request_id': 'req-449763f5-2197-4720-8c3a-d9058743253a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:57.309568 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649bd1b9ad174a7bab4fb0e617cdfb35', 'request_id': 'req-449763f5-2197-4720-8c3a-d9058743253a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:57.316674 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649bd1b9ad174a7bab4fb0e617cdfb35', 'request_id': 'req-449763f5-2197-4720-8c3a-d9058743253a'} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:57.326959 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] The token cache is being invalidate because project 649bd1b9ad174a7bab4fb0e617cdfb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81579) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 13:21:57.327248 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:57.327909 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG keystone.notifications [None req-449763f5-2197-4720-8c3a-d9058743253a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81579) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 13:21:57.329404 dv-cinder-826607-8-smb devstack@keystone.service[81579]: [pid: 81579|app: 0|req: 1321/2619] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 13:21:57 2022] DELETE /identity/v3/projects/649bd1b9ad174a7bab4fb0e617cdfb35 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 13:22:07.002553 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:07.323899 dv-cinder-826607-8-smb devstack@keystone.service[81579]: DEBUG dbcounter [-] [81579] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:23:13.780339 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Authenticating user token {{(pid=81580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 13:23:13.781758 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:23:13.849176 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10d7e-ffdb-4aad-8645-c50d1e3fdeb4 admin admin] Validating token access rules against request {{(pid=81580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 13:23:13.906344 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8c2cffed4c54b0ea5cbde5b7d3f5b6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f29514a70d30401dbbc899b779affa25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 13:23:13.907474 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] REQUEST_METHOD: `GET` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 13:23:13.907757 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] SCRIPT_NAME: `/identity` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 13:23:13.908028 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 13:23:13.909748 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.fernet_utils [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 13:23:13.920660 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 13:23:13.922789 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699e60-ec89-4929-a9cb-5758ec6fb88b service placement] RBAC: Authorization granted {{(pid=81580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 13:23:13.932476 dv-cinder-826607-8-smb devstack@keystone.service[81580]: [pid: 81580|app: 0|req: 1299/2620] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 13:23:23.928291 dv-cinder-826607-8-smb devstack@keystone.service[81580]: DEBUG dbcounter [-] [81580] Writing DB stats keystone:SELECT=58 {{(pid=81580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}